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Abstract 


A  new  approach  is  presented  to  the  problem  of  finding  a 
global  (i.e.  absolute)  minimizer  of  a  function  of  several  real 
variables,  and  some  of  its  mathematical  properties  are  investi¬ 
gated  . 

The  approach  is  based  on  the  idea  of  following  the  solution 
trajectories  of  a  stochastic  differential  equation  inspired  by 
statistical  mechanics. 

We"  also  describe  a  complete  algorithm  (SIGMA)  based  on  the 
above  approach,  which  looks  for  a  point  of  global  minimum  by  mo¬ 
nitoring  the  values  of  the  function  to  be  minimized  along  a  num¬ 
ber  of  simultaneously- evolving  trajectories  generated  by  a  new 
(stochastic)  scheme  for  the  numerical  integration  of  the  sto¬ 
chastic  differential  equation. 

Finally' we  describe^the  software  package  SIGMA  which  imple¬ 
ments  the  above  algorithm  in  a  portable  subset  of  the  A.N.S.  FOR 
TRAN  IV  language,  a  number  of  carefully  selected  test  problems 
designed  for  testing  the  software  for  global  optimization,  and 
the  results  of  testing  SIGMA  on  the  above  problems,  and  on  a 
problem  of  theoretical  chemistry. 

The  main  conclusion  is  that  the  performance  of  SIGMA  is 
very  good,  even  on  some  very  hard  problems. 
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1.  Introduction 


This  is  the  final  report  on  the  work  done  from  December 
1981  to  December  1984,  under  contract  n.  DAJA  37-81-C-0740  awar¬ 
ded  to  Universita  di  Camerino,  Italy,  on  the  research  project 
"Numerical  Optimization",  by  the  principal  investigator  France¬ 
sco  Zirilli  and  his  co-workers. 

The  objective  of  the  research  was  to  develop  a  new  method 
for  global  optimization,  founded  on  a  stochastic  differential  equa 
tion  obtained  by  means  of  a  time-dependent  stochastic  perturba¬ 
tion  of  an  ordinary  differential  equation. 

This  included  working  on  the  mathematical  foundations  of 
the  method,  and  building  up  a  robust  numerical  algorithm  for  glo 
bal  optimization. 

The  research  has  produced: 

-  The  development  of  a  robust  numerical  algorithm  for  global  op¬ 
timization,  the  algorithm  SIGMA. 

-  Studies  on  the  mathematical  foundations  of  the  method. 

-  An  extensively  tested  and  well-performing  FORTRAN  implementa¬ 
tion  of  the' algori thm ,  the  software  package  SIGMA. 

-  The  development  of  a  set  of  carefully  selected  problems  to  be 
used  for  testing  global  optimization  software. 

-  Two  FORTRAN  subroutines  implementing  the  above  set  of  test 
problems . 

-  A  successful  application  of  the  algorithm  to  a  problem  in  theo 
retical  chemistry. 

The  research  has  also  stimulated  scientific  contacts  with 
several  italian  and  foreign  scholars. 

The  results  of  the  research  have  been  disseminated  by  means 
of 

-  Six  research  papers  submitted  to  high-standard  professional 
or  academic  journals  (three  of  them  already  accepted  for  pu¬ 
blication  )  . 

-  Short  communications  on  the  work  in  progress  in  national  and 
international  scientific  meetings  in  Rome,  Bonn,  Milan,  Bo¬ 
logna. 

-  Seminars  at  the  University  of  L'Aquila,  University  of  Salerno, 
Rice  University  (Houston,  Texas),  and  Fondazione  Donegani , 
Milan . 


2.  The  proposed  method  for  global  optimization 

We  consider  the  problem  of  finding  a  global  minimizer  of 
a  given  real-valued  function  f  of  N  real  variables  , . . . , x  , 

i.e.  the  point  x*  =  (x*,...,x*'>  in  the  N-dimensional  real  eucli¬ 
dean  space  3R^  such  that  f  attains  at  x*  a  global  for  "absolute") 
minimum,  defined  by 

(1)  f(x*)  ^  f(x)  for  all  x  =  (x1,...,xN)e  1RN 

We  assume  that  the  function  f  is  sufficiently  regular,  that 
its  minimizers  are  isolated  and  non-degenerate,  and  that  (for 
reasons  that  will  become  clear  later) 

(2)  lim  f(x)  =  +  ® 

II  x  ||a*  - 

in  such  a  way  that 

(3)  exp (-2f (x)/e2)  dx  <  +  ® 

for  all  real  e  ^  0. 

The  interest  of  the  global  optimization  problem  both  in  ma¬ 
thematics  and  in  many  applications  is  well  known  and  will  not 
be  discussed  here. 

We  want  just  to  remark  here  that  the  root-finding  problem 
for  the  system  g(x)  =  0,  where  giUr1-*-  3R  ^  can  be  formulated  as  a 
global  optimization  problem  considering  the  function 

2 

F(x)  =  lljj(x)||2  ,  where  ||  •  ||2  is  the  euclidean  norm  in  ]R  . 

Despite  its  importaince  and  the  efforts  of  many  researchers 
the  global  optimization  problem  is  still  rather  open  and  there 
is  a  need  for  methods  with  solid  mathematical  foundation  and 
good  numerical  performance. 

Much  more  satisfactory  is  the  situation  for  the  problem  of 
finding  the  local  minimizers  of  f,  where  a  large  body  of  theore¬ 
tical  and  numerical  results  exists. 

Ordinary  differential  equations  have  been  used  in  the  study 
of  the  local  optimization  problem  or  of  the  root  finding  problem  by 
several  authors.  The  above  methods  usually  obtain  the  local  mi- 


nimizers  or  roots  by  following  the  trajectories  of  suitable  or¬ 
dinary  differential  equations. 

The  simplest  example  is  the  first-order  "steepest  descent" 
equation 

(4)  =  -  vf<x) 

dt  — 

where  if  is  the  gradient  of  the  function  f  to  be  minimized. 

However,  since  the  property  of  being  a  global  minimizer  is 
a  global  one,  that  is,  depends  on  the  behaviour  of  f  at  each 
point  of  1R^ ,  and  the  methods  that  follow  a  trajectory  of  an  or¬ 
dinary  differential  equation  are  local,  that  is,  they  depend 
only  on  the  behaviour  of  f  along  the  trajectory,  there  is  no 
hope  of  building  a  completely  satisfactory  method  for  global 
optimization  based  on  ordinary  differential  equations. 

The  situation  is  different  if  we  consider  a  suitable  sto¬ 
chastic  perturbation  of  an  ordinary  differential  equation. 

If  we  perturb  the  steepest-descent  differential  equation 

(4)  by  adding  a  "white-noise"  term,  we  are  led  to  consider  the 
(Ito)  stochastic  differential  equation 

(5)  dj,  =  -VfU)  dt  +  e  dw 


where  r  is  the  gradient  of  the  function  f  to  be  minimized,  w(t) 
is  a  standard  N-dimensional  Wiener  process  ("Brownian  motion"), 
and  e  is  a  real  "noise"  coefficient. 

Such  equation  is  known  as  the  Smoluchowski-Kramers  equation, 
and  can  be  considered  as  a  singular  limit  of  the  second-order 
Langevin  equation,  when  the  inertial  (i.e.  second-order)  term 
is  neglected. 

The  Smoluchowski-Kramers  equation  has  been  extensively  used 
by  solid-state  physicists  and  chemists  to  study  physical  pheno¬ 
mena  such  as  atomic  diffusion  in  crystals  or  chemical  reactions. 

In  these  applications  eq.  (5)  represents  diffusion  across 
potential  barriers  under  the  stochastic  forces  edw,  where 

T  is  the  absolute  temperature,  k  the  Boltzmann  con- 
a  suitable  mass  coefficient,  and  f  is  the  potential 


=(2kT)^ 


m 


s  t  an  t ,  m 
energy. 

The  use  of  the  above  equation  is  suggested  by  the  behaviour, 
for  constant  e,  of  the  stochastic  process  £(t),  solution  of  the 


equation  starting  from  an  initial  point  x 


O' 


It  is  well  known  that  the  probability  density  function 


p  (x,t)  of  the  (random)  value  at  time  t  of  the  solution  process 
tends,  as  t  *  °°  (if  condition  (3)  holds),  to  a  limit  "equili¬ 
brium"  density 

-  (2/  e  J)f  (x) 


(6' 


p  (  X  )  - 


where  A  is  a  normalization  constant. 

The  equilibrium  density  is  independent  of  the  starting  point 


-0 


and  is  peaked  at  the  global  minimizers  of  f,  with  narrower 
peaks  if  c  is  smaller. 

In  physical  terms  this  indicates  a  greater  concentration 
of  particles  at  lower  temperatures  around  the  global  minima  of 
the  potential  energy. 

Moreover  in  the  limit  e  -  0  the  equilibrium  density  becomes 
a  weighted  sum  of  Dirac's  deltas  concentrated  at  the  global  mi¬ 
nimizers  of  f . 

In  order  to  obtain  the  global  minimizers  of  f  as  asympto¬ 
tic  values  as  t  ■*  °°  of  a  sample  trajectory  of  a  suitable 
stochastic  differential  equation  it  seems  natural  to  try  to 
perform  the  limit  t  *  ®  and  the  limit  £  *  0  together.  We  the¬ 
refore  consider  the  equation  (5)  with  time-varying  e,  that  is 


(7: 


dC  =  -Vf(5)dt  +  e ( t ) dw 


with  initial  condition 


(8) 

where 


1(0)  = 


(9)  lim  e(t)  =  0. 
t  -*■  00 

In  physical  terms  condition  (9)  means  that  the  temperature 
T  is  decreased  to  absolute  zero  when  t  -*■  =>  ,  that  is,  the  system 
i s  "frozen" . 

Since  we  want  to  end  up  in  a  global  minimizer  of  f,  that 
is,  a  global  minimizer  of  the  (potential)  energy,  the  system  has 
to  be  frozen  very  slowly  ( adiabatical ly ) . 

Several  mathematical  questions  related  to  the  solutions  of 
eqs.  (5)  and  (7),  such  as  the  way  in  which  p^  (x,t)  approaches 
p  (x)  for  a  class  of  one-dimensional  systems,  or  the  rate  at 
which  s  i  t  ■  should  go  to  0  in  eq.  (9),  are  considered  in  Appen- 


dices  1  and  2. 

The  method  we  propose  looks  for  a  global  minimizer  of  f  by 
monitoring  the  values  of  f  along  a  number  of  simultaneously- 
evolving  numerical  solution  trajectories  of  the  Cauchy  problem 
(7),  (8),  which  are  generated  by  a  new  (stochastic)  numerical- 
integration  scheme. 


3.  The  algorithm  SIGMA 


A  global  minimizer  of  f(x)  is  sought  by  monitoring  the  va¬ 
lues  of  f(x)  along  trajectories  generated  by  a  suitable  discre¬ 
tization  of  the  stochastic  differential  equation 


d_£  =  -7f(_£)dt  +  e  ( t ) dw 
with  initial  condition: 


1(0)  -  £0 


where  vf  is  the  gradient  of  f,  w(t)  is  an  N-dimensional  stan¬ 
dard  Wiener  process,  and  the  "noise  coefficient"  e(t)  is  a  po¬ 
sitive  function.  The  discretization  has  the  form 


£,  .  =  £,  -  h  y(  £  )  + 

— k+1  — k  k—  — k 


X 


‘(tk’  (VV 


k  =  0,1,2, 


— 0  =  ^0 


where  h^  is  the  time  integration  steplength,  —  y_(£k)  is  computed 
as  a  finite-differences  approximation  to  the  directional  deri¬ 


vative  of  f  in  a  randomly  chosen  direction,  and  u^  is  a  random 


sample  from  an  N-dimensional  standard  gaussian  distribution. 

We  consider  the  simultaneous  evolution  of  a  number  N  of 
trajectories  during  an  "observation  period"  having  the  duration 
of  a  given  number  N^p  of  the  time  integration  steps,  and  within 
which  the  noise  coefficient  ^(t)  of  each  trajectory  is  kept  at 


a  constant  value  e  ,  while  the  steplength  h  and  the  spatial  in- 

P  k 


» 


o 


Clearly  p^y  La  the  probability  density  of  a  random  variable  ' ^ 
'O  that  "  it)  *  •'  in  law  when  t  *  ■«.  Let  us  remark  that  p  ' 
does  not  depend  on  the  initial  condition  x, . 

We  want  to  study  the  behaviour  of  p'J  as  -  0  and  the  rate 
of  approach  of  p  to  p_  as  t  -  ■«.  We  will  consider  for  the  sake 
of  simplicity  only  the  one-dimensional  case  when  f  is  as  in  Fig.  1, 
i.e.  wath  three  extrema  at  the  points  x  x,  x  ,  decreasing  in 
!  •  *  ,  x  )  and  (x  ,x  ;  and  increasing  in  (x  ,x.  )  and  (x  ,  +  m),  with 
: :  a  i  -  -  as  x  -  in  such  a  way  to  satisfy  (11)  for  all  \  +  i). 

We  have 


=  U. 


*  i.e  following  notation 


=  t  x 


c ,  = 


d;  f  . 
dx- lX+J 


:x.) 


if.  =  f  -  f.  •  o 


; t  . ease  to  :  rove  the  following  result . 


reo<'>  it  ! (an  J  .  1  .  i.et 


he  as  above  and  let  c  ,  c+ ,  c  he  greater  than 


f  '  f  and  •  .-lich  that  fix)  -*  I  x  -  x  '  +  1  Vx  1R 


*1 


n 


5 


Let  ?L°(t)  be  the  stochastic  process  solution  of  (5),  (6);  for 
any  Borel  set  A  cj/1  we  define 

Ptr°(0,xo,t,A,)  =  F(Ce°(t)  €  A)  (7) 

£ 

where  IP( • }  is  the  probability  of  {•},  and  P  °(0,x  ,t,A)  is  the  tran- 

£ 

sition  probability  of  £  °(t).  Under  regularity  assumptions  for  f  we 
have 

pt'°(0,x0,t,A)  =  |  p£o(0,x0,t,x)dx  (8) 

A 

where  the  transition  probability  density  p  =  pl‘o  10 ,x0  ,t ,xj  satisfies 
the  following  Fokker-Planck  equation: 

^  Ap  +  div  (Vf  p)  (9) 


with 

lim  p£ 0 (0 ,x0 ,t  ,x)  =  6(x  -  x  )  (10) 

t-»o 


where  A  and  div  are  the  laplacian  and  the  divergence  with  respect  to 
x  and  ■■(  •)  is  the  Dirac  delta  function. 

Let  A  be  defined  by 

L  0 


1/A 

L 


0 


e';,f(x)/eo 


dx  < 


Bf 


(ID 


then  as  t  *  the  transition  probabi  1  ity  density  pL°(0,x  ,t,x)  approaclies 
the  funct  ion 


p“°(0,x0,x)  =  At 


-■-’f(x)/e 
e  o 


(12) 


>-7  ir.'J’ji™  w.  J.  .PJ 


T*  ■'■  "f  V 


Method 


Let  us  consider  the  Cauchy  problem 


d^  =  -Vf(^)  dt  +  -  ( t )  dvv' 


;(o)  =  x. 


(3) 


(4j 


for  the  i  Ito)  stochastic  differential  equation  (3),  where  fdRJ1  -  R  is 
the  function  to  be  (globally)  minimized,  7f  is  the  gradient  of  f, 
w(t)  is  an  n-dimensional  standardized  Wiener  process,  and  -  ( t i  is  . 
given  function.  We  assume  that  f  and  are  sufficiently  well-behaved 
so  that  our  statements  are  meaningful;  in  particular  we  assume  that 


and 


lim  f(x)  =  +  °° 


i  x  ii 


iY<  x  >  , 
e  dx 


ra  *  R\ { 0 } . 


ajul  that  f  lias  only  a  finite  number  of  isolated  global  minimi  tors. 

We  promise  to  numerically  integrate  problem  1,3) ,  (.4)  lotting 
tiie  as'-r.rtot  ic  value  of  a  sample  numerical  trajectory  solution  to  obt 
a  global  minimi zer  of  f.  Let  us  start  b>  considering  the  problem  (7'. 
wiii'M  :  M  =  -  is  a  constant;  that  is 


a.:  = 


’flf.'ut 


-  i  :V 


■_dw(t) 


minimizers  of  f,  with  narrower  peaks  if  the  constant  £0  is  smaller. 

The  method  we  propose  attempts  to  obtain  a  global  miniinizer  of  f 
by  looking  at  the  asymptotic  value,  as  t  -+  °°,  of  a  numerically  computed 
sample  trajectory  of  an  equation  like  (2)  where  e  is  a  function  of  time 
c ( t)  which  tend  to  zero  in  a  suitable  way  as  t  -*  Similar  ideas  in 
the  context  of  discrete  optimization  have  been  introduced  by  Kirkpatrick, 
(Jelatt  and  Vecchi  (Ref.  4)  . 

In  Sect  ion  2, we  describe  our  method;  in  Section  3,  we  consider  the 
numerical  integration  problem;  and, in  Section  4,  we  present  the  results  of 
numerical  experiments  on  several  test  problems. 


that  is,  it  depends  on  the  behavior  of  f  on  each  point  of  IR11,  and  the 
methods  that  follow  a  trajectory  of  a  system  of  ordinary  differential  equa 
t  ions  are  local,  that  is  they  depend  only  on  the  behavior  of  f  along  the 
trajectory,  there  is  no  hope  of  building  a  completely  satisfactory  method 
for  global  opt imicat ion  based  on  a  system  of  ordinary  differential  equa¬ 
tions.  However,  the  situation  is  different  if  we  consider  a  suitable  sto¬ 
chastic  perturbation  of  a  system  of  ordinary'  differential  equations  as  we 
now  describe. 

Let  us  consider  the  (.  I  to)  stochastic  differential  equation 

dd  =  - 7f (y)dt  +  dw  i  - 

where  Tf  is  the  gradient  of  f  and  w(t)  is  a  standard  n-dimensionai 

Wiener  ’process.  When  c  =  c  -  is  a  constant,  Eq.  (d)  is  known  as  ti*. 

chow  ski -Kramers  equation  (Ref.  5).  This  equation  is  a  singular  limit  oi  .. 

Lan  gov  in's  equation  when  the  inertial  terms  are  neglected.  The  Smoluchew: 

Kramers  equation  iias  been  widely  used  by  solid  state  physicists  and  che: 

to  study  physical  phenomena  such  as  atomic  migration  in  crystals  or  chemic 

/  . 

reactions.  In  these  applications  . .=  v  where  T  is  the  absolute 

temperature,  k  the  Boltzmann  constant,  m  the  reduced  mass  and  f  tne 
potential  energy,  so  that  (d)  represents  diffusion  across  potential  bar: 
under  the  stochastic  forces  dw. 

It  is  well  known  that  if  i  At)  is  the  solution  process  of  (d 
inc  from  ail  initial  point  \.  ,  then  the  probability  density  function  ot 
n  .ip.rieaeiies,  as  t  •*  «- ,  the  limit  density  A  e  f  where 

is  u  normal i cut  ion  constant!.  The  limit  dens itv  is  independent  of  x_ 

;  -  i-;:^c\i  indicating  concent  rat  ion  of  "particles"!  around  tire  global 
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1.  Introduction 


Let  be  the  n-dimensional  real  Eucl  idean  space  x  =  (xt  ,x_> , . . .  ,xn)TeIRn 

and  let  f:Rn  -*  ]R  be  a  real  valued  function.  In  this  paper  we  consider  the 
problem  of  finding  the  global  minimizers  of  f ,  that  is  the  points  x*  e 


such  that ; 


f  (x*)  <  f  (x) ,  Vx  e  IR11, 


A  new  method  to  numerically  compute  the  global  minimizers  of  f  by  follow¬ 
ing  the  paths  of  a  system  of  stochastic  differential  equations  is  projxxsed. 
This  diet  hod  is  motivated  by  quantum  mechanics. 

The  importance  of  the  global  optimization  problem  is  clear.  For 
example,  the  root  finding  problem  for  the  system  g(x)  =  0,  where  g-JRn-*IRn 
can  be  formulated  as  a  global  optimization  problem  by  considering  the  func¬ 
tion  I’(x)  =  ||g(x)||*,  where  ||  •  ||  is  the  Euclidean  norm  in  U^1.  Despite 
its  importance  and  the  contributions  of  many  researchers,  the  situation 
with  respect  to  algorithms  for  the  global  optimization  problem  is  still  un¬ 
satisfactory  and  there  is  a  need  for  methods  with  a  solid  mathematical 
foundation  and  good  numerical  performance.  The  situation  for  the  problem 
of  finding  the  local  minimizers  of  f  is  much  more  satisfactory  and  a 
large  body  of  theoretical  and  numerical  results  has  been  established;  see 
for  example  Ref.  1  and  the  references  given  therein. 

Ordinary  differential  equations  have  been  used  in  the  study  of  the 
local  optimization  problem  or  of  the  root  finding  problem  by  several  authors; 
for  a  review  see  Ref.  2.  These  methods  usually  approximate  the  local  optimi¬ 
zers  or  roots  by  following  the  trajectories  of  suitable  systems  of  ordinary 
differential  equations.  However,  since  property  (1)  is  a  global  property, 
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Abstract.. 


x 


Let  TR  be  the  n- dimensional  real  Enc  1  i de a n  space, 

(x^x^,  ...  ,  x  ) T  e  1R11  and  f:lRn  -+  ]R  be  a  real  valued  function.  We 
consider  the  problem  of  finding  the  global  minimizers  of  f.  A  new  method 
to  numerically  compute  the  global  minimizers  by  following  the  paths  of  a 
system  of  stochastic  differential  equations  is  proposed.  This  method  is 
motivated  by  quantum  mechanics.  Some  numerical  experience  on  a  set  of 
test  problems  is  presented.  The  method  compares  favorably  with  other  exist 
ing  methods  for  global  optimization. 

Key  Words:  Global  optimization,  stochastic  differential  equations. 
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TABLE 


that  the  performance  of  SIGMA  is  very  satisfactory  from  the 
point  of  view  of  dependability  (only  2  incorrect  claims  on  the 
"large"  dynamic  range  machine  when  Ngyg  >  3  and  on  the  "small" 
dynamic  range  machine  when  >  4)  and  robustness  (no  overflows 

on  both  machines). 

Unfortunately,  given  the  state  of  the  art  of  mathematical 
software  for  global  optimization,  it  has  not  been  possible  to 
make  conclusive  comparisons  with  other  packages. 

Finally,  we  note  that  a  smaller  value  of  NgyC  gives  a  much 
cheaper  method  (less  function  evaluations)  at  the  expense  of  a 
loss  in  effectiveness  (greater  number  of  failures). 

7.  Application  to  a  problem  in  theoretical  chemistry 

SIGMA  has  been  successfully  applied  to  a  problem  in  theore¬ 
tical  chemistry,  namely  the  problem  of  finding  spatial  patterns 
of  minimum  intramolecular  energy  for  a  particular  DNA  fragment. 
The  problem  and  the  results  are  described  in  the  paper  (in  ita- 
lian)  which  is  enclosed  as  Appendix  7. 


8  Conclusion 

A  method  for  global  optimization  based  on  stochastic  dif¬ 
ferential  equations  has  been  proposed,  and  its  mathematical  pro¬ 
perties  have  been  investigated. 

A  complete  algorithm  has  been  developed,  which  is  based  on 
following  a  number  of  simultaneously-evolving  sample  trajecto¬ 
ries  generated  by  a  new  stochastic  scheme  for  numerically  inte¬ 
grating  a  first-order  stochastic  differential  equation. 

The  algorithm  has  been  coded  in  a  portable  subset  of  the 
FORTRAN  IV  programming  language,  and  the  resulting  software  has 
been  experimentally  tested  on  a  large  set  of  test  problems:  35 
out  of  37  problems  were  successfully  solved,  including  some  very 
difficult  ones. 

The  software  package  has  also  been  used  for  solving  a  pro¬ 
blem  in  theoretical  chemistry. 

Working  for  the  project  has  stimulated  a  number  of  scienti¬ 
fic  contacts,  and  the  project  results  have  been  disseminated  in 
six  research  papers  for  professional  or  academic  journals,  and 
in  a  number  of  seminars  and  communications  to  scientific  meet- 
gs 
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set  of  test  problems,  and  a  paper  containing  the  problem  set  and 
the  complete  FORTRAN  coding  of  the  two  subroutines  has  been  sub¬ 
mitted  to  the  ACM  Transaction  on  Mathematical  Software  (see  Ap¬ 
pendix  A3)  . 

A  detailed  description  of  the  test  problems  and  of  the  use 
of  the  FORTRAN  subroutines  is  given  in  Appendix  A3. 


6.  Numerical  testing 

SIGMA  has  been  numerically  tested  on  a  number  of  test  pro¬ 
blems  run  on  two  computers. 

The  test  problems  are  described  in  detail  in  Appendix  3. 

The  tests  were  performed  on  two  typical  machines  of  "large" 
and  "small"  dynamic  range,  that  is,  with  11  and  8  bits  for  the 
exponent  (biased  or  signed)  of  double  precision  numbers,  and  cor 
responding  dynamic  range  of  about  10-3os  and  10~38.  The  machines 
were : 

-  UNIVAC  1100/82  with  EXEC8  operating  system  and  FORTRAN  (ASCII) 
computer  (level  10R1)  ("large"  dynamic  range) 

-  D.E.C.  VAX  11/750  with  VMS  operating  system  (vers.  3.0)  and 
FORTRAN  compiler  (vers.  3)  ("small"  dynamic  range). 

Operating  conditions  for  the  tests,  and  detailed  results 
are  reported  in  Appendix  4. 

Table  1  reports  summarized  data  concerning  the  effective¬ 
ness,  dependability  and  robustness  -  in  the  form  of  total  num¬ 
bers  of  correctly  claimed  successes,  correctly  claimed  failures, 
incorrect  success  or  failure  claims  and  total  number  of  over¬ 
flows  -  for  the  two  machines  and  for  different  values  of  Nsuc  (sect.  3), 

The  SIGMA  package  seems  to  perform  quite  well  on  the  propo¬ 
sed  test  problems. 

As  it  is  shown  in  Annex  3  some  of  the  test  problems  are  ve¬ 
ry  hard;  for  example,  Problem  28  (N  =  10)  has  a  single  global 

1  0 

minimizer  and  a  number  of  local  minimizers  of  order  10  in  the 
region  |x.|  4:  10  i  =  1,2,. ..,10. 

Table  1  shows  that  from  the  point  of  view  of  the  effective¬ 
ness  as  measured  by  the  number  of  correctly  claimed  successes 
the  performance  of  SIGMA  is  very  satisfactory;  moreover,  it  is 
remarkably  machine  independent  (note  that  completely  different 
pseudo-random  numbers  sequences  are  generated  by  the  algorithm 
on  the  two  test  machines).  The  results  of  Table  1  also  suggest 


4.  The  software  package  SIGMA 

The  software  package  SIGMA  is  a  set  of  FORTRAN  subprograms, 
using  double-precision  floating-point  arithmetics,  which  attempts 
to  find  a  global  minimizer  of  a  real-valued  function  of  N  real 
variables,  by  means  of  the  algorithm  SIGMA,  which  is  described 
in  sect.  3  and  in  Annex  A4. 

The  package  consists  of  a  principal  subroutine  SIGMA,  a  set 
of  34  auxiliary  subroutines  and  functions,  and  an  "easy-to-use" 
driver  SIGMA1  which  can  be  used  to  call  SIGMA. 

All  the  coding  is  written  in  FORTRAN  IV  and  meets  the  spe¬ 
cifications  of  PFORT,  a  portable  subset  of  A.N.S.  FORTRAN. 

The  SIGMA  package  contains  a  total  of  about  1900  statements 
(including  some  700  comment  lines).  This  amounts  on  the  ASCII 
FORTRAN  compiler  (with  optimization  option)  of  the  UNIVAC  EXEC8 
operating  system  to  a  storage  requirement  of  about  4000  (36-bit) 
words  for  the  instructions,  about  3500  words  for  the  data,  and 
about  14,000  words  for  the  COMMON  area.  The  requirement  for  the 
array  dimensions  are  4N  36-bit  words. 

The  SIGMA  package  and  its  usage  are  described  in  full  de¬ 
tail  in  Annex  A5;  the  complete  listing  of  the  FORTRAN  code  is 
in  Annex  A6 . 


5.  Test  problems 

Since  the  early  phases  of  the  project  the  need  arose  of  ex¬ 
perimentally  testing  the  preliminary  versions  of  the  algorithm, 
in  order  to  detect  possible  weak  points  or  to  compare  the  perfor 
mance  of  alternative  design  choices.  Experimental  testing  of  an 
algorithm  is  usually  performed  by  running  its  software  implemen¬ 
tation  on  a  number  of  test  problems:  and  therefore  a  collection 
of  test  problems  naturally  began  to  build  up  during  project  de¬ 
velopment,  including  problems  specially  conceived  for  the  pro¬ 
ject  needs  by  the  present  authors,  and  problems  reported  in  the 
literature . 

By  the  end  of  the  project  a  final  collection  of  37  test  pro 
blems  was  available:  it  was  coded  in  the  form  of  two  FORTRAN 
subroutines,  and  was  used  for  the  final  testing  of  the  final  ver¬ 
sion  of  the  algorithm  (sec.  6). 

It  was  felt  that  the  collection  could  be  useful  to  the 
scientific  community  as  a  first  attempt  to  provide  a  standard 
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crement  for  computing  are  automatically  adjusted  for 
each  trajectory  by  the  algorithm. 

At  the  end  of  every  observation  period  a  comparison  is  made 
between  the  trajectories:  one  of  the  trajectories  is  discarded, 
all  other  trajectories  are  naturally  continued  in  the  next  ob¬ 
servation  period,  and  one  of  them  is  selected  for  "branching", 
that  is  for  generating  also  a  second  continuation  trajectory 
which  differs  from  the  first  one  only  in  the  starting  values  for 
e p  and  Ax^,  and  is  considered  as  having  the  same  "past  history" 
of  the  first. 


The  number  ^TRAJ  simu:i-'taneously  evolving  trajectories 
remains  therefore  unaffected,  and  the  second  continuation  trajec 
tory  takes  the  place,  from  a  program-implementation  point  of 
view,  of  the  discarded  trajectory. 

The  set  of  simultaneous  trajectories  is  considered  as  a  sin 
gle  trial,  and  the  complete  algorithm  is  a  set  of  repeated 
trials.  A  single  trial  is  stopped,  at  the  end  of  an  observation 


period,  if  a  maximum  given  number  Npj^^  ° f  observation  periods 
has  been  reached,  or  if  all  the  final  values  of  f(x)  (except  for 
the  discarded  trajectory)  are  equal  (within  numerical  tolerances, 
and  possibly  at  different  points  x)  to  their  minimum  value  fTFMIN 
("uniform  stop"  at  the  level  fTFMIN^ •  In  the  former  case  the 
trial  is  considered  unsuccessful,  while  in  the  latter  case  a  com 


parison  is  made  between  the  common  final  function  value  f^MIN 
and  the  current  best  minimum  function  value  fgp.j>  found  so  far 
from  algorithm  start:  if  f^MIN  >  ^OPT  the  trial  is  again  cons.i 
dered  unsuccesful;  and  if  N  =  ^OPT  (within  numerical  tole¬ 

rances)  the  trial  is  considered  successful  at  the  level  f^PT* 

The  trials  are  repeated  with  different  operating  conditions 
(initial  point  xQ,  maximum  trial  length  NpMAX,  seed  of  the  noise 
generator,  policy  for  selecting  the  starting  value  for  £p  in 
the  second  continuation  trajectory  after  branching,  and  trial- 
start  values  for  e  )  and  the  complete  algorithm  is  stopped  -  at 
the  end  of  a  trialP-  if  a  given  number  Ng^g  of  uniform  stops  at 
the  current  fgpip  level  has  been  obtained,  or  if  a  given  maximum 
number  of  trials  has  been  reached:  success  of  the  algo¬ 

rithm  is  claimed  if  at  least  one  uniform  stop  occurred  at  the 
final  value  of  fopT* 

A  detailed  description  of  the  algorithm  is  given  in  Appen¬ 
dix  A5. 


(13) 


e 

lim  pj  (0,x  x)  =  6(x  -  x  ) 

V0 

(ii)  if  Af  _  =  Af+  and  3  a  >  0  such  that  f(x)  >  a(x-x  )2  +  f  Vx  xQ 
and  f(x)  >  a(x-x+)  +  f  Vx  >  x0  then 

lim  i^°  (0,xQ,x)  =  y  <^(x-x  )  +  (l-y)6(x-x+)  (14) 

Cq-M) 

where  y  =  (1  +  /(c  /c  )  )"L 

where  the  limits  (13),  (14)  are  taken  in  the  distribution  sense.  Proposition 
2.1  is  easy  to  prove  using  the  Taylor  foniula  for  f  around  x  ,  x+. 

Remark  2.1.  Proposition  2.1  shows  that  as  eQ  -+  0,  the  asymptotic  probability 
density  approaches  a  Dirac  delta  function  concentrated  on  the  global  minimizer 
when  there  is  a  unique  global  minimizer  (Af  >  Af  ) ,  or  approaches  a  linear 
combination  of  Dirac  delta  functions  concentrated  on  the  global  minimizers 
(Af_  =  A f+) .  The  coefficients  of  the  linear  combination  depend  on  the  curva¬ 
ture  of  f  at  the  global  minimizers.  These  statements  have  a  clear  meaning 
e 

in  terms  of  .  finally,  Proposition  2.1  can  be  easily  generalized  to  a 
wider  class  of  functions  f. 


Proposition  2.2.  Under  the  previous  hypotheses  for  f,  Matkowsky  and  Schuss 

e0  en 

studied,  Rei .  5.,  the  rate  oi  convergence  of  p  to  pw  as  t  -*  00  by  look¬ 
ing  at  the  eigenvalues  of  the  Fokker-Planck  operator 


(.)  =  IdL  il y_+  (df 

'  2  3x2  3x  hLx 


) 


We  note  that  pm°  is  an  eigenfunction  with  eigenvalue  zero  of  L  , 

c  0 

so  that  the  rate  of  approach  to  p  is  determined  by  the  next  eigenvalue 

A1(cq)  of  1.  .  Matkowsky  and  Shuss  obtained  for  Aj(£0)  the  following 


asymptotic  expression  as  c0 


0: 


/c+co  "  ? 


2  It 


(15) 
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So  that  roughly  speaking  we  can  imagine: 


'o  fO 


f  ft  „ 

,x  ,t,x)  =  p;3  +  expj  ;  AjCeJdsj  p 


(16) 


where  p  is  an  eigenfunction  corresponding  to 

When  f(x)  is  a  fourth  order  polynomial  with  two  minimizers,  a 

complete  analysis  of  the  spectrum  of  L  in  the  limit  e0  -*•  0  has 

c  o 

been  given  by  Angeletti,  Castagnari,  Zirilli  in  Ref.  6. 


Remark  2 .  2.  Since  \,  (s.)  0  as  -;0  -*•  0  from  (16)  we  see  that  the  rate 
of  approach  to  p^3  became  slower  when  e9  became  smaller.  On  the  other 

c  n 

hand  from  (12)  we  see  that  px.v  becomes  more  and  more  concentrated  around 

the  global  optimizers  as  cQ  goes  to  zero. 

Let  us  go  back  now  to  (3),  (4)  when  c  =  e(t)  is  a  given  function 

of  t  and  let  g(t)  be  the  solution  of  (3),  (4).  Let  P(0,x0,t,A)  be 

the  transition  probability  of  Z(t)  and  p(O,x0,t,x)  the  corresponding 
probability  density.  Under  regularity  assumptions  for  f,  the  probability 
density  p  satisfies  the  following  Fokker-Planck  equation: 


iP.  =  clill  yp  + 

•  t  2  1 

div  (7f  p) 

(n 

lim  p(.0,x,  ,t,x) 
t-*  o 

*  ;(x  -  x0) 

(18) 

In  order  to  compute  the  global 

optimizers  of  f 

by  following  the  paths 

of  (3) ,  ' 4 )  we  would  like  to  s 

how  that 

1  im  piO ,x, ,t,x) 

£  -**jO 

m 

=  T  a.  (x  -  x*) 

.  °  .  i  i 

l  =  . 

(19) 

m 

where  . .  are  positive  constants  such  that  > 

i  •  _  , 

=  1  and  x*. 

i  =  1,2,3,  ...  ,  m  are  the  global  minimizers  of  f. 


The  previous  analysis  of  the  correpsonding  problem  with  e(t)  =  eQ 
suggests  that  in  order  to  have  (19)  we  need 


lim  e(t)  =  0 

t^-KX) 


and,  as  suggested  by  (16),  we  must  require  that 

2 


[ 


y  ,r  <-  Af 

e  e2^)  +  dt  =  co 


(20 


C2i: 


where  Af  is  the  highest  barrier  to  the  global  minimizers.  We  note  that 
in  order  to  satisfy  (21)  e(t)  must  go  to  zero  very  slowly. 

The  problem  of  giving  a  mathematically  rigorous  foundation  to  our 
method  by  proving  (19)  will  be  considered  elsewhere.  Based  on  the  heuris¬ 
tic  conditions  (20),  (21)  we  will  consider  now  the  problau  of  how  to  inte¬ 
grate  numerically  (3),  (4)  in  order  to  obtain  a  global  minimizer  of  f. 
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Numerical  Integration  of  (3),  (4) 


In  the  previous  sections  we  have  proposed  to  obtain  the  global 
minimizers  of  f  by  following  the  paths  defined  bv  (3),  (4)  under  suit¬ 
able  assumptions  for  -ft)  when  t  -  «.  We  want  to  consider  here  the 
problem  of  how  to  compute  numerically  these  paths  keeping  in  mind  that 
we  are  not  really  interested  in  the  paths,  but  only  in  their  asymptotic 
v;  1 1  ues . 

The  algorithm  we  propose  here  is  only  prel im inarv  and  further 

study  is  needed;  however,  as  we  will  see  in  Section  4  even  the  present 

algorithm  gives  good  numerical  results  on  several  test  problems. 

k-; 

Let  :t,  •  0,  t,  =  "it.  (t„  *0),  k  *  0,1,  ;  we  dis- 

K  N  .  i. 

1  =  0 

cretize  (5),  (.4)  using  the  Euler-Cauchv  method,  that  is  £(t^)  is 
approximated  by  solution  of  the  following  finite  difference  equations; 


k+1  '  k  =  'Atk  *  ’(tk)  ("kd  "  wk^ 


(221 


0,1, 


■o  = 


(23) 


Since  for  stability  reasons  It^  will  be  chosen  rather  small  and  since 
condition  (21)  implies  that  ;-(t)  should  go  to  zero  very  slowly  in  order 
to  reach  the  asymptotic  values  of  the  naths  of  (3) ,  (4)  we  expect  that  a 
large  number  of  time  integration  steps  (22)  will  be  needed. 

Let  r  be  an  n -dimensional  random  vector  of  length  1  uniformly  dis- 


r:.’”.ltvd  •'! 

a  ti.e  i 

n-1 )  -dimens ional  sphere; 

then  tor  any  given  non-random 

ccrer  v 

Kn, 

its  projection  <v,r>  r 

along  r  is  such  that 

!'  •  L  i  4v,r>  r)  = 


v 


where  t: ( * )  is  the  expected  value  and  <•,•>  is  the  Euclidean  inner  pro¬ 
duct  in  JRn.  Tl\i s  suggests  that  in  order  to  save  numerical  work  (i.e.  func 
tions  evaluations)  we  may  substitute  to  Vf(fk)  in  eq.  (22)  the  expression 

n  <  Vff£k)  ,  r  >  r  (24) 

where  n  <  Vf(Ck),  r  >  r,  the  directional  derivative  in  the  direction  r, 
may  be  further  approximated  by  finite  differences  with  some  mesh  size  Ax^.. 

When  forward  differences  are  used  n+1  function  evaluations  are 
needed  to  approximate  Vf  while  only  2  function  evaluations  are  needed  to 
approximate  the  directional  derivative.  Finally,  some  heuristic  algorithms 
are  used  to  choose  At  and  Ax,^  to  avoid  instabilities.  Condition  (21) 
suggests  that  e(t)  should  go  to  zero  very  slowly  as  t  goes  to  infinity 
so  that  computing  a  single  path  of  (3),  (4),  choosing  e(t)  as  required  by 
(2L)  and  following  this  path  for  a  long  enough  period  of  time  to  obtain  a 
global  minimizer  does  not  seem  very  efficient. 

We  have  considered  this  alternative  strategy: 

(i)  N  paths  of  (3),  (4)  are  computed  (N  >  1;  N  =  7  in  the  numerical 
experience  shown  in  section  4)  with  the  algoritlun  described  before, 
and  e(t)  is  kept  constant. 

(ii)  f  is  computed  along  the  paths  and  used  as  a  merit  functions.  After 
a  number  of  steps  of  numerical  integration  the  N  computed  paths  are 
compared.  The  "worst"  path  is  discarded,  the  numerical  integration 
is  continued  after  splitting  one  of  the  remaining  N-l  paths  into  two 
paths . 

The  new  path  has  a  different  value  of  c(t)  =  const:int;  e(t)  is 
usually  decreased,  occasionally  it  can  be  increased  if  the  paths 


4.  lest  Problems  and  Numerical  Experience 


The  algorithm  described  in  section  2  and  3  has  been  tested  on  a 
set  of  test  problems.  The  first  eighteen  test  problems  have  been  taken 
from  the  literature,  and  were  proposed  as  a  set  of  problems  to  test  global 
optimization  methods  by  Levy  and  Montalvo,  Ref.  7. 

We  shall  make  use  of  the  penalization  function 


u(x,a ,k,m) 


k(x-a)"' 

i  0, 

kCx+a)"; 


x  >  a  , 

-a  <  x  <  a , 
x  <  -a  . 


The  test  problems  are: 

Problem  L.  (loldstein’s  F miction.  Let  f(x)  =  x6  -  15x4  +  27xz  +  250;  the 
function  f  has  three  minima: 

x  =  -3,  f(x)  =  7, 

x  =  0  ,  f  (x)  =  250, 

x  =  3;  f(x)  =  7 . 

The  minimizer  x  =  ±3  are  the  global  minimizers  of  f. 

5 

Problem  2^.  Penalized  Shubcrt  Function.  Let  gx  (x)  =  l  i  cos  ((i+l)x+l); 

i  =  i 

the  function  gx  is  the  Shubert  function.  We  define  the  penalized  Shubert 
function  f(x)  as  follows: 


f(x)  =  gx(x)  +  u(x , 10, 100 ,2) . 

This  function  has  19  minima  in  the  region  ix|  |x|  <  10}  ;md  three  of 
them  are  global  ones  and  they  are  located  at: 
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x  =  -"."0851,  x  =  -1.42512,  x  =  4.85805. 

Problem  _5.  [wo -dimensional  Penalized  Shuhert  Function.  Let 

■'  2  .  '  f  :  'i 

t(x,yj  =  g  1  cos1 (i+l )x+L !  t  ,  \  l  cos<  ( i+l )y+ll 

i  =  i  ’  i  =  i  -1 

+  u(x, 10,100,2)  +  ufv, 10, 100,2) 

Hie  function  f  has  “bO  minuna,  (18  of  them  are  global  minima)  in  the 
region  -(x.y)'  x  10,  ;vj  -  10}. 

Problem  J_.  Two-dimensional  Penalized  Shubert  Function  e  =  0.5. 

i  '  f  -  ,  ) 

fix, yi  =  L  i  cos; ( i+l )x+l  '  \  i  cosf(i+l)v+l] ! 

i  = :  •  i  =  i 

+  •( (x+1. 42515) :  +  (y+0 .80032) 2 } 

+  u(x, 10, 100,2)  +  u(y, 10, 100,2) 

^here  -  0.5  .tnd  i -1.42515.  -0.80052)  is  a  point  where  the  function 
f  v.  itii  .  ~  o  has  a  global  minimi zer. 

Hus  function  has  roughly  the  same  behaviour  of  the  function  considered  in 
problem  5  out  has  a  unique  global  minimizer  at  (-1.42515,  -0.80052)  where 
the  function  f  is  equal  to  -1 8b. 7509. 

Problem  .  Fwo-d imensional  Penalized  Shubcrt  Function  2=1.  The  function 
f  is  the  one  given  in  problem  4  with  2=1. 

P’-ohlem  Panel  unction.  Let  f  be  given  hv 

f(x,v:  =  (1  -  2.  lx'  +  -W-l  x  *  \v  +  (  - 1  +4v~)y 

. a .  .  c.v*  a  .  mini ,  two  of  them  are  global  minima  and  are  located 


Problems  7-9  are  obtained  from  the  following  formula: 


g2(x)  =  £  {k2sin27T  y1  +  l  [(y  -A2)2(l+k2sin2  tt  y  )  +  (y-A2)2)} 

i=i  n 

(25) 

where  x  =  (x1,x2,  ,  xn)T,  y.  =  1  +  (x.-l)/4  i  =  1,2,  ...  ,  n, 

k2  =  10  A2  =  1. 

Ln  the  region  n  =  (x  e  R|  -10  <  x.  <  10  i  =  1,2,  ...  ,  n}  the  func¬ 
tion  (25)  has  roughly  5n  local  minimizers  and  a  unique  global  minimizer 
located  at 

x^  =  1  i  =  1,2,  . . .  ,  n. 

We  penalize  the  function  (25)  as  follows: 

n 

f(x)  =  g2(x)  +  l  u(x. ,10,100,4)  (26) 

i  =  i 


Problem 

_7. 

The 

function 

f(x) 

is  given  by 

(26) 

with 

n  =  2. 

l’robl  em 

_8. 

The 

function 

f(x) 

is  given  by 

(26) 

with 

n  =  3. 

jhloblcm 

_9_. 

The 

function 

f(x) 

is  given  by 

(26) 

with 

n  =  4. 

Problems  10-12  are  obtained  from  the  following  formula: 

n-i 

g3(x)  •  J  {k3sin2TrXl  +  J  (x-L -A3) 2 (l+k3sin2TTxi  +  i)  +  (xn-A3)2} 

(27) 

where  k,  =  10,  A,  =  1  and  x  =  (x  ,x  ,  ,  x  ) T 

In  the  region  f!  =  (x  cKn|  -  10  x^  <  10  i  =  1,2,  ...  ,  n)  the  function 
(27)  has  roughly  10n  local  minimizers  and  a  unique  global  minimizer  at  x^  - 
i  =  1,2,  ...  ,  n.  We  penalize  the  function  (27)  as  follows: 


Snrrwr vt1'.  ■.'.!%  ■I'VW'W  *v ■• 


.,!■  .1.,  ■  J_l  I..  I  I  J  I  I  I  ^1  . 


, , J  ,  ,  ■  . 


1(3 


g,(.x)  + 


1  =  1 


u (x .  ,10,100,4) 


Prob 1 em 

10. 

fhe 

funct  ion 

fix) 

LS 

given 

bv 

128) 

with 

n  =  5. 

Problem 

1 1 . 

ITie 

function 

f  (x ) 

is 

g  iven 

bv 

(28) 

with 

n  =  8. 

Problem. 

]  •> 

Hie 

function 

tlx) 

is 

given 

by 

(28) 

with 

3 

<1 

C 

Problems  13-1-H  'ire  obtained  from  the  following  for- 


m  uia: 


r,  ;x  i  =  n  s  i  n'  " i  .  x 


n  - : 

i=i 


‘tu  -A.J  “  ( l+kc<in“"trxi+. ) 


+  ( x  -A , i ‘ ( 1 +k  c  s  m ‘ ~£ , x  ) 1 
n  -  *  n- 


where  k__  =  .  1 ,  k .  =  1  ,  A  =1,  £.  =  3,  £i  =  2. 


(28) 


(29) 


In  the  region  =  i x 


-  10  -<  \o  <  10  1  =  1,2,  ...  ,  n}  the  function 


’>i  •,  w- 


-,,n 


has  roughly  30  local  minimi  tors  and  a  unique  global  minimize!’  at  x ■  - 

i  -  1.2,  ...  ,  n. 

in  the  region  =  1  x  -  IRn  -3  ^  x-  <  S  i  =  1,2,  ...  ,  n}  the  function 

L 

If* )  has  roughly  1  .V*  local  minimiters  and  a  unique  global  mininiter  at 
x-  =  1  i  -  1,2.  ...  ,  n.  he  penalize  the  function  i  29)  as  follows: 


fix)  =  g  (x)  +  ul\. ,10,100,4) 

u  •  i 

i  =  1 


or 


n 

f ,  a )  -  g  i x  J  r  __  u( x  ,1,1 00,4 ) 
i  = : 

'ronlem  !  7u  :he  funct ion  fix)  is  given  be  (30)  with  n  =  2. 

'  r  4  ■  I  '1.  ih--  •'  met  ion  f  f  \  i  is  given  bv  i  7,0  >  with  n  =  3. 


(30' 


(." 
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Problem  15.  The  function  f(x)  is  given  by  (30)  with  n  =  4. 

Problem  16.  The  function  f(x)  is  given  by  (31)  with  n  =  5. 

Problem  17.  The  function  f(x)  is  given  by  (31)  with  n  =  6. 

Problem  18.  The  function  f (x)  is  given  by  (31)  with  n  =  7. 

The  problems  19-22  have  been  created  by  the  third 


Problem 

16. 

Problem 

17. 

Problem 

18. 

The 

;  tuLl  icr. 

Problem 

19_. 

one  for 

pos 

the  global 

Prob 1  cm 

20. 

minima  i 

tv 

Problem 

19. 

minimizer. 

Problem 

21 . 

x1*  x2 


Problem  21.  Let  f(x,y)  =  0.5  x2  +  .5  (1  -  cos  2x)  +  y2,  the  function  f 
has  several  local  minima  and  the  global  minimizer  is  the  origin. 

Problem  2_2.  Let  n  >  0  and  f(x,y)  =  I0nx2  +  y2  -  (x2+y2)2  +  10m(x2+y2)'' , 

the  function  f  has  a  local  minimum  at  the  origin  and  two  global  minimizers 
on  the  y  axis. 

f  5  "I  h  T 

Problem  23.  Let  f(x)  =  \  ix2,  where  x  =  (xa ,  ...  ,  x5),  the  func- 

l  i = i  1 ! 

t ion  f(x)  has  a  unique  minimizer  at  x  =  0  where  the  function  is  not 
differentiable,  moreover  the  hessian  of  f(x)  is  not  defined  at  x  =  0  and 
is  not  positive  definite  in  a  neighborhood  of  x  =  0. 


L8 


The  remaining  problem  -4  has  teen  suggested  bv  S.  Wolff,  Ref.  8. 
Problem  24.  Let 

f('x,y)  =  -F(x,y)  +  u(x,  10'*  ,100,2)  +  u(y ,  10** ,  100 ,2) 
where  P(x,yi  =  it  [  -  (r^rr- ) 1 1  H  - 

V  V 

l  = : 

the  data  points  x;  *.  are  riven  bv: 

1201  1225  1244 

1  l  1 

1356  1370  1390 

1  1  1 


!he  function  f,'x,y)  has  an  absolute  minimi zer  at  (1523.2,  277.5)  and  a 
spurious  relative  minimizer  due  to  the  penalization  at  (-6607.3,  -10  ). 


i  l 


1219  13"!  137"  1144 

0  0  0  1 


1326  1351 


ana 


fX 


.‘(X)  =  e 


•t "/2  dt 


The  numeri.aal  results  obtained  are  shown  in  Table  1. 


TABIJ2  1 


•obi  cm 

Nl-'l 

Whether  a  global 
minimizer  has 
been  found 

Nh'2 

Whether  a  globa 
minii.iLzer  has 
been  found 

l 

3,184 

Yes 

7,168 

Yes 

~> 

26,893 

Yes 

77,099 

Yes 

5 

3,218 

No 

241 ,215 

Yes 

4 

8,755 

Y^s 

70,894 

Yes 

5 

97,761 

Yes 

183,819 

Yes 

0 

5,393 

Yes 

10,822 

Yes 

n 

/ 

84,782 

Yes 

159,549 

Yes 

8 

19,041 

Yes 

72,851 

Yes 

9 

18,942 

Yes 

49,690 

Yes 

10 

18,433 

Yes 

72,226 

Yes 

1  1 

4,322 

No 

1 30 ,061 

Yes 

12 

49,701 

Yes 

98,985 

Yes 

13 

9,492 

Yes 

23,770 

Yes 

14 

19,114 

Yes 

66,010 

Yes 

15 

35,139 

Yes 

122,166 

Yes 

10 

53 , 398 

Yes 

66 ,365 

Yes 

17 

15,534 

Yes 

98,974 

Yes 

18 

16.542 

Yes 

109,886 

Yes 

Remarks 


OO 

17,61c 

:  £S 

4,042, 

661 

Yes 

n=-m=6 

25 

15,105 

54, 

1 10 

Yes 

54 

43.  so: 

Yes 

fl9  , 

515 

Yes 

fhe  pros’ ram  is  run  twice  on  each  problem,  the  first  time  with  a 
given  stopping  criterion.  NFl  is  the  number  of  function  evaluations 
(including  the  ones  needed  to  evaluate  the  gradient)  used  in  this  first 
run  while  the  result  obtained  is  shown  in  column  3.  The  second  time  the 
program  is  run  with  a  more  stringent  stopping  criterion  and  the  columns 
-l ,  3,  have  the  same  meaning  as  columns  3,  3,  respectively.  All  the  remain¬ 
ing  parameters  (initial  value  for  it)  etc.  ...)  are  fixed  once  and  for 
all  during  the  runs. 

Ihe  initial  point  x.  has  been  chosen  as  follows: 
x.  =i'  for  Problems  1-  (a- 
x.  =  1/3U  for  Problem  19 

J 

x.  =  (1,0)  for  Problem  30 
x  =  (-3,0)  for  Problem  31 
x  =  i 0,1)  for  Problem  33 
x  -  i  10",  Id’,  ...  ,  ID1)  for  Problem  35 
x  =  (-1530,  -1000)  for  Problem  54. 

For  I  mb  fan;  19-55  and  54  the  initial  point  \,  has  been  chosen 
cli’O'  to  a  local  mimmicer. 

The  condition  number  of  the  :essi.m  it  the  solution  of  Problem  55 

Poems.  so  m  a.  *.“.e  aoiwrien  of  P  mo  lorn  .53  is  not  de¬ 
fined:  sa  sd:  ‘  he  ssl  rs  n  ■:  ;  n  f  L  '•  La  iLL— -ondit  ioned;  "he 

.  •’■wuraa  ••  :  n  •:  :  r  •  ;  :  •  'a  i  on.  m  ao)  it- i  i-ns . 


1  4a  -  F4a4+9e2 
v  =  ±  — 


(ii)  since  V_(y)  is  even  let  us  consider  only  y  >  0,  by 
explicit  computation  it  is  easy  to  obtain  the  following  table: 


1  i  ! 

:c/6 

a/2 

>  I  ,  i  /4a2-/4-.t4+9e4 

/  4:>.2+/4a4+9e2 

1  1  °  '  J 

V  JtL. 

1 

3e 

€ 

/  3e2 

i  i  8a6 -27  ■■•.2e*  + 

1  J 

i  1 

5  2a6 

1~  ~  2 
-/£ 

1 

i 

1 

-4 [a2 

.1  pfsct 6  -  2  7a 2  £  2  - 
2  /  £  2(_ 

-C4a4+9e2)3/2j 

1  .  I 

v;(v)  i  0  1  0 

1  ! 

j 

1  .7- 

|  -  Zj.  £  ►  0 

-Gae/2 

1 

1  ° 

i  !  | 

j  Vy (y)  8a1*  -  6e2  3r4:  +9"'}  '  ^ 

i  i  !  -4a2/4a‘’+9e2  j 

II!  1 

-  be2 

i  * 

32a4 -6e2 

(4  <.4+9e2)  + 

3l 

+  4a2/4a4+9ez 

Table  1 

(where  •'  means  differentiation) 

(lii)  V  (y)  is  bounded  below  by  a  constant  independent  of  £ 
( iv)  V  (y)  is  given  by  Fig.  3. 


(2.20) 


IL  (v)  .  -  <*!£*£.] 

b  H  I  dy  J  dy2  ) 


'2(2ae2y2  +  y  +  2c) 2  -  l(6a£2y2  +  y  +  2c) 

Jl  /2 


=  a2c4yC  +  —  e3yS  +  (t  b2+2ac)e2y4  +  —  e  y3  + 


,  2  2-\  2  3be 

+  (c  oae  )y - y  -  c 

y'l 


In  order  to  understand  intuitively  the  behavior  as  e  -*■  0  of 
the  spectrum  of  when  the  potential  W£(y)  is  given  by  V£  or  U£ 

let  us  analvze  the  behavior  of  V  and  U  when  £  -*•  0. 

e  e 


Proposition  2.1.  Let  V£(y)  be  given  by  (2.19),  then  (y)  is  an 

even  sixth  degree  polynomial.  There  exists  £0  >  0  such  that  for 
0  <  s  <  e  0 : 


(i)  the  equation 


(2.21) 


(y)  =  0 


has  five  real  roots 


v  =  0  y  =  ± 


4a2  t  /4a4+9e2 


that  is,  V  has  a  local  minimizer  at  y  =  0,  two  global  minimizers 


1  i  4-(  +  r'4a-+9t2  !  ,  „  . 

at  v  =  t  - t  and  two  local  maximizers  at 


6 


In  this  paper  we  will  consider  the  case  when  f(x)  is  given 
by 


(2.15) 

f i (x)  =  (x~-a‘) i  a  >  0, 

x  S  1R 

or  by 

(-.14) 

f 2  fx)  =  x“ (ax'+bx+c) 

x  0  R 

where 

:t  >  0,  a,  b,  c,  are  real  constants  and 

(2.15) 

a  >  0 

(2.16) 

b‘-4ac  <  0 

12.1") 

9b2-32ac  >  0 

(2.18) 

b  <  0 

Since  the  spectrum  of  is  invariant  with  respect  to  adding 

a  constant  to  f,  to  making  translation  on  the  x-axis,  or  to  changing 
x  into  -x,  f j (x)  represents  the  most  general  fourth  degree  polynomial 
with  two  global  minimiters  (Fig.  1)  and  f 2  (x)  represents  the  most 
general  fourth  degree  polynomial  with  one  global  minimiter  and  one 
local  minimiter.  Let  us  remark  that  (2. IS),  (2.16)  implies  that 
f2  (x)  >0  V'x  6  R,  with  f2(x)  =  0  «=>  x  =  0,  (2.1")  implies  that 
f!(x)  =  0  has  three  real  roots  0,  x^ ,  x2  and  that  f"(x)  =  0  has 
two  real  roots,  that  is  x,  is  a  maximiter  of  f,  ;md  x2  is  a 
minimiter  of  f.,ix);  finally  (2.18)  implies  that  0  <  x,  <  x2  (Fig.  2). 

A  straightforward  computation  gives: 


5 


Let  us  note  that  H£  is  a.  Schrodinger  hamiltonian.  It  is  easy 


to  verify  that 


(2.8) 


i  -f  (y)/2 
v0(y)  =  c2  e 


y  6  JR 


is  a  solution  of  (2.5)  when  A  =  0,  corresponding  to  v0(y)  we  have 


(2.9)  u„(x)  =  c.e'2/fe2  f(x) 


x£K 


solution  of  (2.1)  when  A  =  0.  Since  we  would  like  to  interpret  u0(x) 
as  the  probability  density  of  a  random  variable  we  will  assume  that 


(2.10) 


+  00  ~2fc2  f  (x) 


dx  <  00  Ve  /  0 


and  we  will  choose 


(2.11) 


+  ”  -2/e2f(x), 

e  dx 


so  that 


(2.12) 


u0 (x)dx  =  1 


Condition  (2.12)  means  that  u0(x)  6  L1 QR)  this  implies  that 
v0(y)  G  L2QR)  where  L^QR)  is  the  Lebesgue  space  of  index  p,  so 
that  it  is  natural  to  study  the  spectrim  of  Hf  in  L2  01) . 


§2.  From  the  Fokker-Planck  equat ion  to  the  Schrodinger  equation. 

Let  us  consider  the  eigenvalue  problem 

(2.1)  L  i.u)  =  u  \  G  <E,  x  e  1R 

where  I.  is  given  by  (1.4). 

Let  us  consider  the  change  of  variables 


_!  t\(y)/2  r  r  i 

(2.5)  v(y)  =  c  2  e  u;  —  y [ 

1  vT 

where  c.  is  a  normal ization  constant  and 

(2.4)  f . (y)  =  4  ff  -4  y  ■ 

*  '  '  v'2  ' 

The  eigenvalue  problem  (2.1)  becomes 

(2.5)  H  v  =  - \v  \6C,  v6R 

where 


and 
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The  interest  of  one  of  us  (F.Z.)  in  the  study  of  the  asymptotic 
behavior  of  the  spectrum  of  the  Fokker-Planck  operators  arose  in  the 
study  of  a  method  for  global  optimization  based  on  the  use  of  suitable 
stochastic  differential  equations  [11] . 

In  §2  the  eigenvalue  problem  for  is  reduced  to  an  eigen¬ 

value  problem  for  a  suitable  Schrodinger  hamiltonian  H£.  The  particu¬ 
lar  Schrodinger  hamiltonian  obtained  when  f  is  a  fourth  degree  poly¬ 
nomial  with  two  minimizers  are  studied  in  detail. 

In  §3  some  approximating  hamiltonians  that  will  be  used  later 
are  introduced  and  studied. 

In  §4  all  the  basic  estimates  needed  to  prove  our  main  results 
are  proved. 

In  §5  a  theorem  concerning  the  behavior  as  e  -*■  0  of  the  dif¬ 
ference  between  the  resolvent  of  and  the  resolvent  of  the  approxi¬ 

mating  hamiltonian  is  proved. 

Moreover  the  asymptotic  behavior  as  e  •>  0  of  the  spectrum  of 
11^  and  as  a  consequence  of  the  spectrum  of  L£  is  considered. 

In  §6  using  the  Rayleigh-Ritz  principle  for  a  particularly 
simple  asymptotic  formula  for  the  first  nonzero  eigenvalue  of  L£  is 
obtained. 

Finally  in  §7  the  case  when  f  is  given  by  a  general  smooth 


function  is  considered  formally  and  some  conclusions  are  drawn. 


where  P  l*i  =  Probability  of  {•},  p_  (x,x0,t)  is  the  solution  of 
the  Fokker-Planck  equation: 


11.3) 

$  =  L.(P)  xGR, 

t  >  0 

where  L  (•)> 

the  Fokker-Planck  operator, 

is  given  by: 

(1.4) 

l  tp)  -  4  -  i- !  P 

£  K  2  3x^  jx  {  ’X  ^ 

j  x6R 

subject  to  the 

condition 

(1.5) 

lim  p. (x,x0,t)  =  6(x-x,) 

t-*0 

where  £(•)  is  the  Dirac's  delta. 

The  prooLeta  of  deriving  asymptotic  formulas  as  e  -*•  0  for  t 
first  nonzero  eigenvalue  of  the  Fokker-Planck  operator  has  been  con¬ 
sidered  for  a  long  time  both  on  physical  and  mathematical  grounds.  We 
refer  for  reasons  of  brevity  only  to  the  recent  paper  by  Matkowsky  and 
Schuss  [10]  where  several  Fokker-Planck  operators  including  some  two- 
dimensional  ones  are  considered. 

However,  the  problem  of  studying  the  spectrum  of  the  Fokker- 
Planck  operator  as  c.  ♦  0  has  received  much  less  attention.  In  this 
paper  we  restrict  our  attention  to  the  one -dimensional  case  when  L  is 
given  by  (1.4)  and  f  is  a  fourth  degree  polynomial  with  two  minimizers. 

Fven  in  this  particular  case  the  resulting  problems  is  an  interest 
*ng  singular  perturbation  problem  for  the  ordinary  differential  operator 


§1.  Introduction 


Asymptotic  eigenvalue  degeneracy  due  to  singular  perturbations 
is  a  common  phenomenon  to  many  different  fields  of  applied  mathematics 
such  as  quantum  mechanics  [1] ,  [2] ,  [3] ,  [4] ,  [5] .  [6] ,  statistical 
mechanics  and  quantum  field  theory  [7], 

In  this  paper  we  study  the  behavior  as  the  diffusion  constant 
goes  to  zero  of  the  spectrun  of  a  class  of  one-dimensional  Fokker-Plar 
operators.  The  problem  considered  here  can  be  considered  analogous  for 
the  Fokker-Planck  equation  of  the  anharmonic  oscillator  problem  for  the 
Schrodinger  equation  studied  in  [1] ,  [2] ,  [4] .  In  particular  we  will 
follow  the  path  of  Isaacson  in  [2] . 

Let  us  consider  the  Smoluchowski  approximation  to  Langevin's 
equation  [8],  [9]: 

(1.1)  dx (t)  =  -Vf(x(t))dt  +  e  dw(t) 

where  f  JR  -*■  R  is  a  smooth  function  called  potential,  ]R  is  the  real 
line,  .  is  a  real  parameter,  w(t)  is  a  standard  one-dimensional 
Wiener  process.  The  equation  (1.1)  is  an  Ito  stochastic  differential 
equation  widely  used  in  mathematical  physics  and  engineering  whose 
solution  x  (t)  is  a  stochastic  process. 

The  transition  probability  density  p^  (x,x0,t)  of  x^Ct)  is 
defined  as: 

(1.2)  p  (x ,x? , t)dx  =  Pr  x  (t)  e  (x  ,x+iLx)  jx  (0)  =  x3l 
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The  numerical  experience  contained  in  table  1  shows  tliat  the  present 
implementation  of  our  method  is  much  more  sensitive  to  ill -conditioning  than 
to  the  total  number  of  local  ininimizers.  This  seems  to  be  due  to  the  method 
used  to  numerically  integrate  the  stochastic  differential  equations.  How¬ 
ever,  we  should  remark  that  on  Problems  1U,  11,  12,  16,  17,  18  that  have  a 
very  large  number  of  local  ininimizers  the  global  one  is  obtained  by  using  a 
number  of  function  evaluations  much  smaller  than  the  number  of  local  minimi- 
zers.  Our  method  gives  satisfactory  results  on  all  the  test  problems  in¬ 
cluding  Problem  23  that  is  not  differentiable  at  the  solution.  Finally, 
we  note  that  given  the  stochastic  nature  of  the  method  the  amount  of  work 
needed  to  solve  a  problem  depends  on  the  problem  and  on  the  sequence  of 
random  numbers  generated  during  the  numerical  integration. 

We  feel  that  further  work  both  of  mathematical  and  numerical  charac¬ 
ter  must  be  spent  on  the  ideas  presented  in  this  paper. 


Proposition  2.2.  Let  U, (y)  be  the  sixth  degree  polynomial  given 
(2.20).  There  exists  e0  >  0  such  that  for  0  <  e  <  e0: 


(i)  we  can  consider  the  points 


where  x,  , 

1  f  - 

the  points 


ii  y/‘-"  /2" 

>  ~  0>  >1  =  ~  XL»  y 2  =  T  X2 


-5b  +  /9b * -52ac  ,  ^  df2  ,  >.  n 

- ^ -  are  such  that  (xi#J  =  0 


r 

^2 


-5b  +  /9b2 -24ac 

nn 


are  such  that 


-j^r  CCi  ,a)  "  ()' 


Let  us  remark  that  (2.15),  (2.16),  (2.17)  imply  that  £1>2  are  real 
(i.e.  9b  ‘  -  24ac  >  0).  Moreover  0  <  <  xx  <  £2  <  x2  so  that 

o  <  Pi  <  >'i  <  o2  <  y2  • 


(H) 

we  have 

(2.22) 

U’(y)  = 

i(fi£fye-fV') 

(2.25) 

U”(y)  = 

c. 

H(fyc)2  -  f^f-] 

I  r(iv) 

"  2  r 2C 

where  •'  means  differentiation. 

(iii)  by  explicit  computation  from  (ii)  it  is  easy  to  obtain 


the  following  table: 


From  Proposition  2.1  and  Fig.  3  it  follows  that  as  e  0 


V  (y)  approaches  three  independent  harmonic  oscillator  potentials, 

one  with  vertex  at  y  =  0  and  equation  4a4y2  +  2a2  and  two  with 

ry 

vertices  at  y  =  ±  ~  a.  and  equations  I6a"(y  +  ~  a) 2  -  4a2. 

Let  H£  be  given  by  (2.6)  and  W  (y)  =  4a4y2  +  2a2  then 
the  eigenvalues  in  (2.5)  are  given  by 

(2.24)  -\<l)  =  4a2(n+l)  n  =0,1,2,... 

the  eigenvalues  corresponding  to  the  remaining  two  harmonic  oscillators 


are 

(2.25) 

-  X  ^ 2  ^  =  8a  2n 
n 

n  =  0,1,2,  ... 

(2.26) 

■ =  8a 2n 
n 

n  =  0,1,2,  .. . 

In  section  5  we  will  prove  that  the  eigenvalues  of 

(2.27)  Me  =  -  £r  +  vz  (y)  y£R 

approache  (2.24),  (2.25),  (2.26)  when  e  -*•  0.  In  particular  we  will 
show  that  the  first  eigenvalue  X0  =  0  as  e  0  has  asymptotically 

multiplicity  2  (i.e.  Xx(e)  0  when  e  -*  0)  as  can  be  seen  from  (2.25), 
(2.26)  when  n  =  0.  Moreover 

(2.28)  lim  -  *2+4n(e)  =  4a2(2n+l)  n  =  0,1,2 

e-K)  -  ' 

as  can  be  seen  from  (2.24)  and 


(2.29)  liin  -  A3+4nCt:j 

L  >0 


A4+4n  C  =  ^  '  A5+4n(c)  =  8a' ^ 
c-*0 


n  =  0,1 ,2,  ... 

as  cun  be  seen  from  (2.24),  (2.25),  (2.26).  So  that  M£  us  e  0 
has  eigenvalues  with  multiplicity  one  (i.e.  the  ones  coming  from  (2.28)) 
and  eigenvalues  with  asymptotic  multiplicity  three  (i.e.  the  ones  coming 
from  (2.29)). 

from  Proposition  2.2  and  l-'ig.  4  it  follows  that  as  c  0 
U  (y )  approaches  three  independent  harmonic  oscillator  potentials 
one  with  vertex  at  y=0  and  equation  c2y2  -  c,  one  with  vertex  at 
y  =  y1  and  equation  c2(y-yx)2  -  cx  (cx  <  0),  and  one  with  vertex 
at  y  =  y2  and  equation  c2(y-y2)2  -  c2.(C2>0). 

Let  11£  be  given  by  (2.6)  and  W^(y)  =  c2y2  -  c  then  the 
eigenvalues  in  (2.5)  are  given  by 


(2.30) 


-I  <l)  =  (2n+l)  c 


n  =  0,1  ,2, 


(c  >  0) 


the  eigenvalues  corresponding  to  the  remaining  two  harmonic  oscillators 


(2.31) 


-Xn(2)  =  (2n+l)|cJ  -cx  n  =  0,1,2,...  (cx  <  0) 


(2.32) 


—  (  3} 

=  (2n+l)  c2  -c2  n  =  0,1,2,  ...  (c2  >  0) 


In  section  5  we  will  prove  that  the  eigenvalues  of 


approaches  (3. 30),  (3.31  ),  (3.32)  when  -.0.  In  particular  we  will 
show  that  the  first  eigenvalue  *-  =  0  as  -  ^  0  has  asymptotical 1> 
multiplicity  2  i  i.c.  -.()-<>  when  -  -  01 .  The  remaining  eigen¬ 
values,  since  c,  c  ,  c  can  he  expressed  in  terms  of  a,  x;  ,x.  as 

.  •  xT 

shown  m  Proposition  3.3  im),  have  multiplicity  one  it  —  is 
irr;it  ional  ,  have  multiplicity  one  or  three  if  ~~  is  rational. 


I 


I 


I 


I 


§3.  The  approximating  hamiltonians. 

Let  C“QR)  be  the  space  of  the  infinitely  differentiable  func¬ 
tions  of  compact  support.  Let  h0:£>(h0)  c  L2  (JR)  -*■  L2  OR)  denote  the 

2 

self-adjoint  extension  of  -  — -  and  let  P(ym)  denote  the  domain  of 

dy  ^ 

the  self-adjoint  multiplication  operator  ym. 

The  Schrodinger  hamiltonians  M£,  as  operators  on  L2QR) 
possess  the  following  properties: 

Theorem  3.1.  For  any  e  6R  with  e  f  0 

(i)  is  essentially  self-adjoint  on  C“(]R)  and  is  self-adjoint 
on  V(h0)  n  P(yb) 

(ii)  M£  has  compact  resolvent 

(iii)  the  eigenvalues  of  M£  are  non  degenerate 

(iv)  the  eigenfunctions  alternate  parity  and  the  one  corresponding 
to  the  smallest  eigenvalue  is  even. 

Proof:  See  [6]  and  [12] . 

Theorem  3.2:  For  any  c  6  ]R  with  e  ?  0 

(i)  N£  is  essentially  self-adjoint  on  C”@R)  and  is  self-adjoint 
on  P(h0)  n  V(y6) 

(ii)  has  compact  resolvent 

(iii)  the  eigenvalues  of  are  non  degenerate. 


Proof :  See  [6]  and  [12] . 
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Let  A+  =  {y|y  >  ,  A0  =  {y|  |v|  <  ,  A  =  {y|y  <  - 


and  define  V2£  as  follows: 


4a4  y 


a.vE  _  1  _ 1_ 

oe~  2v 


-  4a2  when  v  6  A 


v2£(y)  = 

(3.1) 


-  V0  +  2a2 


cos2$y 


.4  .  a/5  1  1 

4a  y  +  — —  -  —  - 

3c  2v 


when  y  6  A 


4a2  when  y  6  A 


(see  Fig.  5) 


where 


1  =  f  a^7  _  ]  _  2a2  f  3  -o 


oe  j  e* 


(5.3) 


..  _  32  a6 
Vu  =  T  7^ 


[’he  function  V2e  as  e  +  0  is  an  approximation  to  V  in  particular 


V  approaches  three  independent  harmonic  oscillator  potentials,  one 
with  vertex  at  v  =  0  and  equation  4a4y2  +  2a2  and  two  with  vertices 

"T 

at  v  =  t  -iLr  and  equations  I6au(v  +  ) 2  .  4a2. 

t 


Let  0  •  n^c) 


^  6  i\  ■  f  \  1  •  < 

,  0  ‘  n2(0  <  -  with 

¥  Z'J 


%  ,  .  , 
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lim  rl;i (e)  =  lim  n2(e)  =  00 

e-K)  e-K) 

lim  (e)  =  lim  cn2  (e)  =  0 
e-K)  e-*0 


Given  n1C£)  we  choose  n2(c)  to  be  the  smallest  solution  of 


(3.7) 


V^Cn^e))  =  vz£  ^  -  n2(e) 


A  straightforward  computation  shows  that  (3.7)  can  be  solved  and 
that  rjj  (e)  should  be  of  the  same  order  of  n2(e)  for  c  -*■  0. 

Let 


(3.8) 

(3.9) 

we  define 


l[e)  =  (y  6  ]R|n1  (e)  <y  <  -  n2(e)} 

I2(°  =  (y  €F|  -  +  n2(e)  <  v  <-h,(e)  } 


(3.10)  VlC(y)  = 


v2e(y) 

when 

y 

£  Iie)  u 

T(e) 

X2 

V2c(n1(e)) 

when 

y 

e  i1(c)  u 

t(e) 
1  2 

(see  Fig.  6) 


Note  that  Vl£  is  a  continuous  function  because  of  equation  (3.7), 
and  as  e  ■*  0  V'l£  is  an  approximation  to  V£  in  the  same  sense  £ 


Let  us  now  consider  the  operators 


(3.11) 


-  -  &  *  v. 


v  e  f 


we  will  use  them  to  approximate  M . 

The  eigenvalue  problem  for 

(3.13)  M£(2)v  =  Xv  y  6]R,  v  6  L20R) 


can  be  reduced  to  the  following  eigenvalues  problems: 


(3.14) 

M(2)v  =  Xv 
£ 

y  e  a+, 

v  6  L2  (A+) 

(3.15) 

M(2)v  =  Xv 
e 

y  €  a0  , 

v  6  L2 (A0) 

(3.16) 

M(2)v  =  Xv 

£ 

y  e  a_. 

v  6  L2 (A  ) 

The  eigenvalue  problems 

(3.14),  (3.15), 

(3.16)  can  be  solved 

explicitly.  In  fact  the  eigenvalues  and  eigenfunctions  of  (3.14)  and 

(3.16)  are  given  by  [13],  [14]. 

(3.17)  X*£  =  4a2[2nn  -  ~]  n  =  0,1,2,... 


(3.18) 


ne 


=  *V[2o  (y 


- 


2v+l 


)2]' 


exp(-az(y  +  ^  ) 2]l/y) [2a2 (y + “ 


v 

where  N  _  is  a  normalization  constant  and  L  are  the  generalized 
ns-  n  ° 

Laguerre  polynomials  and  is  defined  for  y  >  ,  i>n£  is  defined 

a  ►’5’  , 

v  <  -  -= —  and 

'  it. 


(3.19) 


r  = 


4-  /'4a 4  +  v 2 
2v 


The  eigenvalues  and  eigenfunctions  of  (3.15)  are  given  by  [15]: 


•*> 


(3.:o) 


,\J  =  S2  [n2  +  -l(5n+l)]  +  5.f 

nc  1  J 


n  =  0  1 

4  *  -*  y  1  y  •  •  • 


(3.21) 


f  ■*  ft  -  n  1 

I  cos'5y  F(o  +  2,  2,  sm‘5yj 


when  n  is  even 


!  cos'' 2 v  sinfy  F(  •  "■  — +— ,  -  ti_tt  sin'fvi  when  n  is  odd 


where  F (x -  ,x 2  ,x 3 , z)  is  the  hypergecmet ric  function  uni  •  is  defined  by 
the  equation 


V.  =  82  5  (: -1) , 


The  eigenvalues  of  (3.15)  are  given  by  and 

n-  i .  - 

n  =  0,1,5,  ...  the  eigenvalues  '**.  have  multipl  icitv  two.  Moreover 
as  •:  -  0  2  . ,  A"^  approaches  the  eigenvalues  (5.54),  (5.55),  (2.56) 
of  the  three  harmonic  oscillators  considered  before. 

-r-  d:  -r 

The  eigenfunctions  of  (3.14)  satisfy  :*.(  )  =  —g—  (  A^r*  )  =  0 

so  that  corresponding  eigenfunctions  of  (3.15)  can  be  obtained  extending 
:  Jy)  with  zero  for  y  £  A  .  Similar  statements  hold  for  the  eigen- 


>ns  of  (3.15),  (3.16).  Moreover  since  the  eigenfunctions  of  (5.15) 


are  even  cr  odd  and  the  eigenvalues  A  of  (3.15)  have  multiplicity  two, 
‘he  eigenfunction  of  (3.13)  can  be  chosen  to  be  even  cr  odd. 


I.e  t  C .  JR 


'•)  =  iff  is  5  and  of  compact  support 


nd  is  zero  m  a  nei ghborhood  of  y  * 


a .  6  -  , .  , 

.na  ;.  ae  have: 


:  s  essent  1U1  iv  sc-ii 


'Ll,:,  .,aL  .  •.  . 


f  lea;.,*.- on  fll  Appendix  5. 


Theorem  5.4.  M  is  essentially  self-adjoint  on  CcQR). 

Proof .  It  follows  immediately  from  Theorem  10.23  page  315  of  Weidmann 

[lo]. 


Let  =  ty  ;y  '•  ,  Xa  =  {y  |  -Yi  -n2  <  y  <  n2} 

and  define  U.  as  follows: 


=  (yjv  <  2yx-  n2) 


(3.23)  U,£ 


%  y-n2  -  7^ - —  |  -  c. 

~  (7  2  2v2  y-r,2  ! 


Vo 


cos^Hy-Vi) 


^  0  C1 


when  y  6  A 
when  y  6  A( 


c  ‘  1  1 

—  iv-  (2v,-r.j)  -  7—  -—7^ - v 

4  L  2‘i  >'- C-Yi -n2J_i 


c  when  y  6  A 


(see  Fig.  7) 

where 

(3.24) 

1  _  ,  ,2 
-),  ,  ()  2  ^  2  ) 
-v  2 

(3.25) 

17  *  Oy,-^) 

(3.26) 

r  _  T  1 

2  n,-v, 

(3.27)  Vc  =  77— 


Let  us  remember  that  v  v .  ,n. 


depend  on  f.  (Proposition  2.2).  It 


14.57) 


|vy:(y)| 


y  uu 


<  96a1* 


V  L\) 


< 


4v2  i ..  u/7[  |  s 


|y-^  I 


1  -  n  2  /2v 


Since  equation  (.3.7)  implies  that  1  ini  j]-1  =  constant  /  U 

C-+U 


(4.50)  uni  (4.39)  we  have 


(4.58) 


F  (y) |  <  constant 


1  -  3  a  , 


u/2 


when  |y  -  .  |  <  q.,  (t) 


Reasoning  in  the  same  way  it  can  be  shown  that: 


(4.59) 


F  (y) |  <  constant  e 


1  -  3 


u  i 


when  |y  +  |  <  nk(e).  This  estab)  ishes  estimate  (4.43) 


.et  us  prove  (4.44).  From  Proposition  2.1  (i)  we  know  that 


by  (4.27)  has  three  minimizers  y  =  0,  y  =  ±  —  ^  u  +  |/^u  +^L‘ 


(4 .90) 


t  -nj 


(4.01) 


=  ±  1 

f 4u2  -  /4u‘*+9e2 

i  3 

(♦  I  | 

4u?  -  /4u‘*+9t.‘,l  ‘ 

r  - 

l  3  J 

.  i  (: 

la-  + 

1- 

r  i 

J  ] 

.  Moreover 


32  o 
27  a 


4u?  +  c 


;uk!  for  0  *  t  -  t. , 


1  f4-r  -v4u4+9l.  I2  ,(0  1  (4  c  -  »''4.i‘*+‘.h. 


from  (4.55)  , 


Vc  given 
-  ]  "  and 


„  TCO 


5b 


—  -6 

Mien  |  y  |  <  n^e)  =  e  J 1  we  have 

(4.52)  |V'"(y)|  =  |i:0e“y3-9().i:-:y|  <24e2'^  (5*’‘,*s*  4a*) 

£  ' 

and 

(4.55)  |  V"_  (v)  j  =  52  jcos"5£y| jsiniyj (2+sin~5y) 

<  c  24t^  't3~ 

I  COS5  (4  -i-e1'*1)! 
:u!j 

So  that  when  |y|  <  fi1  (e)  =  e  _1  from  (4.51),  (4.52),  (4.55)  we  have 

(4.54)  j F  (y) |  <  constant  v* 

Mien  jy  -  -  j  <  r,2(e)  we  have  \'t  .  (y)  =  V2(_(y)  so  using  the  Taylor 

formula  at  y  =  — —  we  have 

£ 

—  ^  PM  (;*;) 

(4.55)  F  (y)  =  -6ivT  •:  (y  -  — )  -  5e2(y-*L=.)-  +  —  (y  -  3 

t.  t-  L.  O  .  C 

with  an  intermediate  point  in  the  interval  3-—  ,  v. 

c- 

For  |v  -  [  <  fi2(-:)  we  have: 

(4.5b)  |V"(y)!  <  144  ,2  <3  +  624  rVv  +  560*1  a  s3’"2  +  120  -:'*H3 

and 


Proof:  The  proof  of  (4.40)  follows  from  the  fact  that  on  1R\(I^  J  u  I ^ 

/\ 

we  have  V  =  V  .  The  proof  of  (4.41)  follows  from  the  fact  that 

(4.46) 
and 

(4.47) 

The  proof  of  (4.42)  follows  from  the  fact  that  on  1^  u  we  have 

(4.48)  Vlt(y)  =  V2t(n,(c))  =  V0tg26n1(e)  +  2u2  +  c 

so  that  since  8  and  VQ  are  given  by  (3.3),  (3.4)  we  have 

(4.49)  9  (y)  >  constajit  e  26 1 

for  U  <  o  <  c0. 

Let  us  prove  (4.43).  Let  us  consider  the  function 

(4.50)  F.(y)  =  Vc(y)  -  Vlc(y) 

Using  the  Taylor's  formula  at  y  =  0  we  have 

p;”  (Q 

(4.51)  L  (y)  =  -3e ?y2  +-37  y3 


V  >  V 

2 1.  1C 


T(c)  tU) 
on  I,  u  I:  ' 


0  <  V“‘(V  -V  )  =  1 

2C  2 C  It 


V 


2  e 


with  t,  an  intermediate  j>oint  in  the  interval  (o,yl 
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Definition  4.5.  Let  P2  be  the  projection  on  the  subspace  of  the 
functions  of  L2  QR)  that  have  support  on  ]R  -  where 


u^=  {y  |y|  <  njCe)}  U  {y  |y  -  I  <  n2(e)}  U  (y  |y  +  |  <  n2(e) } . 


That  is  Pi  is  the  multiplication  operator  by  x  ,  ■ ■  Let  us  now 

JR-lTe' 

choose 


(4.59) 


Hi  (e)  =  £  1  0  <  51  <  y3 


n2(e)  will  remain  determined  by  the  equation  (3.7). 


Theorem  4.b.  Let  nx  (e)  be  given  by  (4.59)  and  n2(e)  be  determined 
by  (3.7).  Then  for  0  <  e  <  e0  we  have  the  following  estimates: 


(4.40)  1  (V2£-Vl£)  (I-P,)  II  =  ° 


(4.41) 


(4.42) 


V,!(V,_-V  )PJ  <  constant 


!|  V  ‘Pil  <  constant  e20* 


(4.43)  1  (V.  -V,  .)  (I-P2)  II  <  constant  e 


(4.44) 


1.4.45) 


V"‘(V  -V  )Pi||  <  constant 


V  ‘P  !  <  constant  e'5' 


where  I  is  the  identity  on  L‘  (TR)  and  ||  •  ||  is  the  operator  norm 
induced  hv  the  L"  norm. 


•- .  .*■ 


-  ' 
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(4.33)  (M.  +  z)2  >  V2  on  C^QR)  *  C^OR) 

(4 . 34)  (NlJ 1 }  +  z) 2  >  6V'2£  on  C°°0  0R)  x  c“  QR) 

(4.35)  (M^2)+z)2  >BVje  on  c“0R-{±^-  }  x  C*QR-{±^  }) . 

where  0<  ft  <  1 

Proof:  It  follows  from  Theorem  4.1  since  V"  =  V",  V2  >  V2  and 

-  £  £  ’  £  £ 

c  >  0  and  the  similar  statements  for  V  ,  V  .  V  ,  V  . 

Theorem  4.5.  There  exist  z.  >  0  and  e.  >  0  such  that  for  z  >  z 

'~'i  =  0  0  o 

and  0  <  c  <  t.0  we  have: 


(4.56) 

II  (M  +Z)'1 

*1  < 

iv;M 

Vi  6  L20R) 

(4.37) 

II  (M<1}+z) 

'Ml 

MO1' 

Yv  6  L2  OR) 

(4.38) 

II  (M^2)+z) 

'Ml 

Vip  6  L'QPO 

Proof : 

Note  that  (4. 

27), 

(4.28),  (4.29) 

implv  V  ,  V  ,  V  >  constant  >  0 

t  '  C  1  e  9  2  £ 

so  that  V  !,  \M,  V,  are  bounded  operators.  The  proof  of  Theorem  4.3 
follows  immediately  from  Theorem  2.21,  page  530  of  Kato  [17]. 

Definition  4.4.  Let  be  the  projection  on  the  subspace  of  the 

functions  of  L2  QR)  that  have  support  on  u  iM.  That  is  P, 

is  the  multiplication  operator  given  by  v,  , 

I  j  Ulj 
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(4.26)  (l-Xt(e)_(e)M(l-B)V22e+2zV2e^-\-e>  * 


i; 


<  (e)  T(e)  Ul-3)V2t.(n1)+2zVte  (nj+z2}  + 
!1  Ul2 


+  c/fiCy-Hji+sCy+n,)}  +  c2(S(y -20.  +  n  )  +  5(y  +  ~  -  Fj  ) }  > 


In  fact  for  z  >  z0  >  0,  0  <  c  <  eQ  we  have 


{  (l-8)V‘c+2zV2c+z2-V'2'e}  ^  0.  Moreover 


{Cl-B)V2e(n1)+2zV2c(n1)  +z2}  ^  0  and  c,  >  0,  c2  >  0. 
The  estimate  (4.2)  is  established. 


Let  c  be  a  constant  such  that 


(4.27) 

V  = 
e 

V  +  c  >  0 
e 

and 

(V£+c/  > 

V2 

e 

(4.28) 

A 

V 

\  e 

=  v  £  +  £  >  o 

and 

(Vlc+c)2 

^V>£ 

(4.29) 

/N 

V 

2£ 

=  V  +  c  >  0 

2  £ 

and 

(v  +o2 

2  £ 

>  V2 

2  £ 

We  define 

(4.30) 

A 

M  = 
e 

-JL  +  v  - 

dy2  e 

M  +  c 

£ 

(4.31) 

£,<>> 

e 

d2 

=  -  4= —  +  V 

dy2  i  e 

=  M(1) 
£ 

A 

+  c 

(4.32) 

m(2> 

e 

j2  /A 

=  -  •t~2'  +  V 
dy2  2  £ 

-  m(2) 

£ 

+  c 

Theorem  4.2. 

There  exist  z0  > 

0  and 

S  >  0 

such 

and  0  <  e  <  e0  we  have: 


vV\ 
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The  estimate  (4.3)  has  been  established. 

Let  us  now  prove  (4.2).  Let  0  <  3  <  1  proceeding  as  we  have 
done  proving  (4.1),  we  obtain  as  a  form  on  c”(IR)  x  c”(1R) 

(4.21)  (M^+z)2  -  BV  >  (1-*B)V2  +  2z V  +  z2  -  V" 

t  it.  ic  l  e  l e 

To  prove  (4.2)  it  will  be  enough  to  show  that  for  z >  z0 ,  0<  e <  c0 

we  liave: 

(4.22)  (l-?)V2t  +  2zVi£  +  z2  -  v;e  >  0  ye®. 

Let  X  iri  be  the  characteristic  function  of  u  1^^. 

li  ul2  ;  1  2 

We  have 

(4.23)  vy  =  r  (l-x  (c)  (e))  -  cJSCy-n^Cy*^)] 

-c2[«(y-  ^  +  n2)  +  <Hy +  ■  n2)] 

where  6(*)  is  the  Dirac's  delta  and 

(4.24)  c,  =  2BV0|cos  3bn jSinBfjj  |  >  0 

(4.25)  c2  =  —  I  1  -  /2^  Pj - L_ -  >  0 

flv  (1  -  /2v  Hj) 3 

J? 

are  the  absolute  values  of  the  jumps  at  y  =  ±  and  y  =  ±  (-—  -  n2) 
of  V '  . 

1  K 

Since  Vle  =  V2£  wlien  y  6®\fl^  ul2c^}  we  can  rewrite 


equation  (4.22)  as  follows: 


30 


since  V0  given  (3.4)  goes  to  infinity  when  e  -+  0.  The  last  inequality 
in  (4.16)  holds  Vz>0,  0  <  e  <  5(1  (6(l+fi))1'3. 

For  y  6  A+  fornula  (4.13)  becomes: 

(4.17)  -  4c,7]z  * 

y  3e 

*  (1'»[4o‘(>’-Tr-rr  * 

y  3e 

-  8a4  fl  +  ~  - h|  >  0 

l  4va  (y.^)4) 

with  the  substitution  t  =  2v(v-2^-)2  the  expression  (4.17)  becomes: 


(4.18)  t2(z2-8a2z-8a4)  -  24a4  +  (1-8)  (t-1) 2 -4a2t] 2  >  0,  t  >  0 


When  t  >  i  and  z  such  that  (z2 -8a2z-8a4)  is  positive,  the 
left  hand  side  of  (4.18)  is  greater  than  or  equal  to 


(4.19) 


£(z2 -8a2z-8a4)  -  24a4  >  0  for  z  >  (4+2/30)a2,  e  >  0. 


When  0  <  t  <  £  and  z  such  that  (z2-8a2z-8a4)  is  positive,  then 
the  left  hand  side  of  (4.18)  is  greater  than  or  equal  to 


(4.20) 


-24a4  +  (1-8)  (t-1)  2  -4a2 1] 2 . 


The  expression  (4.20)  is  positive  for  0  <  e  <  e0  since  v 
given  by  (3.2)  goes  to  zero  as  e  ■*  0. 

The  proof  of  (4.3)  for  v  g  A_  is  analogous  to  the  proof  given 
for  y  g  A  and  will  be  omitted. 


"*  .*«  •  . 


and  this  last  expression  can  be  made  positive  for  z  >  z0  and  0  <  e  <  e 
choosing  z0  and  Cj.  The  estimate  (4.1)  is  established. 

Let  us  now  prove  (4.3).  Let  0  <  (T  <  1  proceeding  as  we  have 
done  proving  (4.1)  ,  we  obtain  as  a  form  on  C*(IR-  {  ±  })  *  C^QR-  {  ± 


(4.12) 


(M^2)+z) 2  -  B  V2  >  (1-?)V2  +  2zV2  +  z2  - 


To  prove  (4.3)  it  will  be  enough  to  show  that  for  z  >  zc  , 


0  <  e  <  we  have 


(4.13) 


(l-b)V2E  +  2zV2£  +  z2  -  >  0  y  em. 


For  y  6  A0  formula  (4.13)  becomes: 


(4.14)  z2  +  2(V0tg28y+2a2)z  +  [(1-B) (V0tg28v+2a2) 2  + 


in2By+l  1 
cos ‘•By  J 


when  | y |  <  ^  we  have  cos2By  >  £  and  sin28y  <  £  so  that  the 
expression  (4.14)  is  greater  or  equal  than 


(4.15) 


z2  +  4a2z  -  (60+48)  >  0 


when  z  >  (/64+415-  2)  a*  and  Ve  >  0. 

When  |y|  <  jg-  we  have  sin2 By  >  £  and  cos 2 By  <  £ 

so  that  the  expression  (4.14)  is  greater  or  equal  than 


(4.16) 


?+4ot2z  +  -0^gv  [(1-6) V02  sin4By-8a4 (2  sin28y+l)  ]  > 


>  z2+4a2z  +4  [  V2  -  24a4]  >  0 


A  V  JV 


«r 


(4.7) 


F,  (y2)  =  2zV  +  z2  -  V”  >  0 
1  e  e 


y  e  ir 


Let  us  define 

t  =  y2 
A  =  2z  c  ^ 

B  =  8za2e2  +  30e4 
C  =  2z(4a4-3e2)  +  48a2e2 
D  =  4za2  +  z2  -  8a*  +  6e2 

A  simple  computation  shows  that 

(4.8)  Fj  (t)  =  t(At2-Bt+Q  +  D  t>0 

Let  us  first  note  that  when  z  >  2(/3-l)a2  and  0  <  e  <  2a2  ~ 
have  A,  B,  C,  D  positive.  Consider  now  the  parabola 

(4.9)  At2  -  Bt  +  C 

since  A  >  0,  the  parabola  (4.9)  will  have  a  minimizer  at  t0  = 
where 

(4.10)  At2  -Bt0+C  =  =  *  Jr  (225e2+24a2z+12z2)  <  0 

Moreover  the  equation  At2  -  Bt  +  C  =  0  has  two  real  roots: 

ns.  B  -  /B2  -4 AC  .  .  _  B  +  /B2  -4AC  .  B 

°  <  ti  =  - 2A -  <  t2  =  - 2A -  <  A 

So  that  Vt  >  0 

(4.11)  Fj  (t)  |  (At2  -  Bt0  +  C)  +  D  = 


2  - 


CA^.1* 


O  /-  2 


a  ?  n 
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§4.  The  basic  estimates. 


We  will  prove  here  some  estimates  that  will  be  used  later: 

Theorem  4.1.  There  exist  constants  z0  >  0,  >  0  such  that  when 

z  >  z0  and  0  <  e  <  eQ  we  have 

(4.1)  (M^+z) 2  >  V2  on 

(4.2)  (M(1)+z)2  >  6V2  on 

e  10 

(4.3)  (M(2)+z)2  ^  6V2  on 

e  20 

where  0  <  B  <  1. 

Proof:  Let  us  first  prove  (4.1)  and  let  p  =  i  ^  .  Then  as  a  form 
on  OR)  x  c”QR)  we  have: 

(4.4)  (M^+z)2  =  (p2+VE+z)2  = 

=  p“  +  V2  +  2zV£  +  z2  +  2p(Vc+z)p  -  Vy 
Since  V  >  constant  independent  of  e  when  0  <  e  <  e0  so 

(4.5)  p(V  +z)p  >  0  on  C” (JR)  x  C0  QR) 

for  z  large  enough.  From  (4.4)  and  (4.5)  we  have 

(4.6)  (M^+z) 2  -  V2  >  2zV£  +  z2 -Vy  on  c“(IR)  x  C^QR) 

To  prove  (4.1)  it  will  be  enough  to  show  that  for  z  >  z.  a 

u 


c“0R)  C*  QR) 

C>)  X  C>) 

CyOR-{±^  })  X  c“QR-{  +  }) 


0  <  c  <  e„  we  have: 
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y  6R 

y  6  R 

we  will  use  them  to  approximate  N  . 

(2) 

The  eigenvalue  problem  for  N  can  be  solved  analogously  to 

the  eigenvalue  problem  for  M  in  particular  as  £-*■()  the  eigen- 

£ 

values  of  approach  the  eigenvalues  (2.30),  (2.31),  (2-32)  of  the 

£ 

three  harmonic  oscillators  considered  before. 

Let  C*QR  -  {2v,-n:}  -  (n2))  =  { f } f  is  c”  and  of  compact 
support  and  is  ~cro  in  a  neighborhood  of  y  =  2y1-n2  and  y  =  n2}. 

We  have: 

Theorem  3.5.  N'*' '  ^  is  essentially  self-adioint  on  C^0R  -  (2y,  -n, }  -  (n2 

Proof:  It  is  a  straightforward  modification  of  Isaacson  [2]  .Appendix  2 

(  i  )  1X1 

Theorem  3.6.  N  is  essentially  self-adjoint  on  C0QR). 

Proof :  It  follows  immediately  from  Theorem  10.23  page  315  of  Weidmann 

IM. 


Proceeding  as  before  let  us  now  consider 


!  3 . 32 ) 


^  -  -  &  ♦ 


(3.35) 


v(0 


uv 


+  U, 


is  easy  to  check  by  explicit  computation  that  2y1-n2  >  0  so  that  the 
function  U2e  (Fig.  7)  as  e  -*■  0  is  an  approximation  to  U  .  In  par¬ 
ticular  U2e  approaches  three  independent  harmonic  oscillator  potentials 
one  with  vertex  y  =  0  and  equation  c2y2-c  one  with  vertex  at  y  =  y 
and  equation  c2(y-y1)2  -  cx  and  one  with  vertex  at  y  =  y2  and  equa¬ 
tion  c2(y-y2)2  -  c2. 

Let  UiCe),  y2(e),  u3(e)  >  0  and 

=  (ysR|Ui(t;J  <y<y, -p2  (e)}  and  J2e^  =  {ye]R|y1  +  u2(e)  <  y  <  y2-p3 (e) } 
two  intervals  such  that 

2yx -n 2  £  and  n2  6  J2£^  such  that 

(3.28)  U2e(Ml(e))  -  U2e(yi-u2(e)) 

(3.29)  U2£(y1+u2(e))  =  U2£  (y2-u3  (e) ) 

and  J2£^  =  {<{>},  note  that  because  of  symmetry  U2£(y1-y2 (e))  = 

U2£i(yi+M£)) 

finally  later  we  will  need 

(3.30)  lim  U2e  (v^Uj (c) )  =  *  . 
e-0 

Let  us  define 

*. 

i 

j  U2£(y)  y  <t  u  4e)  ; 

t 

(3.31)  Ul£(y)  =  \  U2e(Vl-u2(e))  y  8  ! 

I  •  « 

I  U2.(yi-u2(£))  y  8  J2(e)  5 


(see  Fig.  8) 


3S 


(4.b5) 


l_  !  4ot2  +  A  r+'J-.: 
£ 


\  i 


t  i}c\  -  l- 


i  i 


(O 


Let  y  €  1^  u  then  V  (y)  =  V,,.  (r^fe))  +  c  so  that 


(4.64) 


where 


(4.65) 


~  ,  v  v^oo)  +  a 

V" 1  ( v  -v  )  *  1 1  -  — L£L  |  <  i  +  — E — _ - 

1  t  ^  it'1  1  r.  1  m(g 


m(e)  =  min  V  (y)  =  min  V  (y)  = 


.(c)  T  ^  £  ) 

y- 1 1  ui2 


V€  I 


(e)  t 


=  minfV  (nj  (-')),  V.(— -  -  n,  (e))/ 

c.  1  t.  t- 

A 

and  (4.o5)  follows  from  the  fact  that  V.  is  even  and  (4.65),  (4.63). 
Ail  elementary  computation  now  shows  that 


(4 .66) 


!y-‘(\-  -V  )j  <  constant,  for  0  <  e  <  e.  when  ygl'k“'’  u  I 


..r(-)  ,,  t<  ) 


1  £ 


Let  y  >  +  n,  ( =:)  we  have  V,  .  (y)  =  \\..(y).  Define  yf  =  y 


q>  6 
3^. 


so  that  we  have  y'  >  n„(e) 


1 


and 


(4.6-) 


Vlc(y)  -  4a‘(y  -  T^rr):  -  4., 


*  4a‘(y'  --±=)!(1  *  rrr=V  - 

/2v  >  »:v 

1  1  7  • 

since  when  y1  >  r,,  (c)  +  — —  we  have  (1  +  - )  <  4  it  follows 

r^7~  ,  r  1  TTT 

V  *.  V  ) 


V  (y)  <  loriy  -  ^  ) 


-  4a:  when  v  >  +  n.U) 


(4 . 68) 


Mo  reove  r 


(4.09)  VJy)  =  -4a2  -  6/2  uo(y-^“)  +  (16a  Me2)  (y  -  ^)  2  + 


+  24/2  a3c (y  -  c-^-)  3  +  ^  .9,-2r„ 


(y~)3  +  26  uc2  (y  -  -~)  ’  + 


a/2.(  5  ^  Hr..  o/2., 


0>/Y  at 3  (y  -  J  +  t.-(y~)' 


a/2 


1'rom  (4.68),  (4.69)  when  0  <  e  <  e0  and  y  >  —  +  p  (c)  we  have 


(4.70) 


V, 


16a1*  + 


Vt- 


n::(£) 


4u2  6/2at 


n?,(0 


n2(t) 


+  16a2  -  3c2 


so  that 


i  r 

V, 


<  constant  when  0  <  e  <  e0.  That  is 


(4.71) 


V1 

C 


a/2 


(V  -V1L)|  <  constant  when  0<c<c0,  y>-~-+n 


Reasoning  in  the  same  way  it  can  be  shown  that 


(4.72) 


r  ^  i  .  ,’  ,ry 

|VT  (Vt-VlL)|  <  constant  when  0<c<e0,  y<- - r 


The  equations  (4.66),  (4.71),  (4.72)  establish  (4.44). 


Let  us  prove  (4.45).  Mien  y  6  l^  u  1^  we  have 


(4.73)  Vlt  (y)  =  V.,L (rij  (e))  +  c 


.i-vv  .•  • 


14.74) 


lun  r\]  (c)  V  (Hi  ( e ) )  =  constant  f  0  . 

e-K) 


From  (4.59)  it  follows  that: 

(4.75)  |V-‘|  constant  e^1  when  0  <  e  <  eQ ,  ye  l[  ^  u  1^. 


Morcove r 


(4.7b)  va  E  C>)  =  V,e(y)  ^  +  n2(e))  when  0  <■  c  <  eD ,  y>2(il  + 


and 


(4.") 


lim  n.  u)  \\  +  n,(s))  =  constant  f  0 


since  n x  0  )  ,  n2U)  are  of  the  same  order  as  e  -*■  0  from  (4. “6),  (4. "7) 
it  follows 


(4.  "8)  |\'7!  j  <  constant  1  when  0  <  r:Q  ,  y  >  +  fi2(t;) 

Reasoning  in  the  same  way  it  can  be  shown  that 

'1  2  <5  'T 

(4.79)  |V\.  |  <  constant  c  1  when  0  <•  c  ^  cQ  ,  v<  -  -hr.  -  ~.(L-). 

The  equations  (4.75),  (4.78),  (4.79)  establish  (4.45). 


This  completes  the  proof  of  Theorem  4.0. 


Theorem  4 , 7 . 


There  exist  constants 


z  >  zu 

and  0  <  e  <  e0 

we 

have: 

(4.80) 

(N  +z) 2 
e 

>  U: 

) 

(4.81) 

(Ne(l)+z) 

2  > 

d  U2 

ie 

(4.82) 

(N(2)+z) 

e 

2  > 

nu2e  on 

whe  re 

o  <TT<  i. 

o  >  0,  c0  >  0  such  that  when 

OO  OCJ 

on  C0  OR)  x  C0QR) 

OO  OO 

on  C0  OR)  x  C0  QR) 

C^QR  -  {2yx-n2}  -  (n2))  x  C^QR  -  ^y^n*) 

{n2}) 


Proof :  Let  us  first  prove  (4.80).  Proceeding  as  in  the  proof  of  (4.1) 

we  can  show  that 

(4.83)  (N  +z)2  -  U2  >  2zll  +  z2  -  U" 

e  c  e  e 

So  that  to  prove  (4.80)  it  will  be  enough  to  show  that  for 
z  '■  z0 ,  0  <  e  <  cq  we  have 

(4.84)  P2  (y)  =  2zU  +  z2  -  U"  ^  0  y  6  IR 

c  e 

A  simple  computation  shows  that 

(4.85)  P2(y)  =  2a2e‘*zy6  +  ^  e3zys  +  {2z(|  b2+2ac)e2  -  SOaVJy1*  + 

n  8 

+  {—  bccz  -  ^  e 3 }y3  +  (2z(c2-3ae2)  -  12(|  b2  +  2ac)c2}y2 

/in  8 


g*rr 


■  ML«  ■  J  "  Jl  ■  J  ■.!  **  ■  B  rr  TTTV^  \ 
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Let  t  =  ey,  rearranging  the  terms  in  (4.85)  we  have 

(4.86)  F2(-)  =  2z{[ij  t2  (2at2+  —  t  +  2c)2  -  (3at2  +  ^  t  +  c)  +  l]  * 

L  c  4  Jl  Jl  1 


-  [30a2t4  +  60ab  +  i2(-|b2+2ac)t2  +  -^bct  +  2c2-6ae2]} 

L“  Jl  8  Jl 

For  z  >  z3  and  0  <  e  <  e0  the  expression  (4.86)  will  be  positive  for 

any  t  €  IR.  This  proves  (4.80). 

The  proof  of  (4.81),  (4.82)  can  be  obtained  from  the  proof  of 
(4.2),  (4.3)  with  only  minor  changes  and  will  be  omitted. 

Let  c*  be  a  constant  such  that 


(4.8") 

0 

£ 

=  U  +  c* 

c 

and 

(U  +  C*)2  £  U 

e  i 

(4.88) 

°ic 

=  U  +  c* 

and 

(U.  +  c*)2  >  i 

cl 

(4.89) 

=  U,  +  c* 

*  t. 

and 

(u2e  +  £*)2  i 

We  define 

(4.90) 

N 

£ 

d2  ~ 

=  -  -f-  +  U  = 
dy-  c 

N  +  c* 

c 

(4.91) 

K 

d2 

=  -  -f—  +  U 
dy  ic 

=  N  + 

ic 

c* 

(4.92) 

A 

N 

zc 

d2  ~ 

-  -  -f—  +  U 
dv*-  2C 

=  N  + 

2  c 

C*. 

Theorem  4.8.  There  exist  z0  >  0  and  e0  >  0  such  that  for  z  >  z0 


and  0  <  £ 

<  £  „  we 

have 

(4.93) 

(N£+z)2  5* 

U2 

C 

on 

Co  00 

00 

x  C0  OR) 

(4.94) 

(N£(l)  +  z)2 

>  3 

/V  r, 

u2 

1  £ 

on 

CQR)  > 

<  C?0R) 

(4.95) 

(N^}+z)2 

>  3 

u2 

2£ 

on 

oo 

cq0R- 

oo 

{2y1-n2})  x  CQ  (1R  -  (2yx  -n2 1 

where  0  < 

0  <  1. 

Proof:  It  follows  from  Theorem  4.7  since  U"  =  U"  ,  U2  >  U2  and 

c*  >  0  and  the  similar  statements  for  0  ,  U  ,  U  .  U  . 

ie’  i  £ ,  2e»  2£ 

Theorem  4.9 .  There  exist  z0  >  0  and  c0  >  0  such  that  for  z  >  z0 

and  U  <  e  <  e0  we  have: 

(4.90)  ||  (Nc  +  z)'Vll  <  II  0:^1  Vip  6  L2QR) 

(4.97)  ||  (N(l)+z)  _1ip||  <  i.llU'Vl  Vtp  6  L2(IR) 

£  |5I  It 

(4.98)  ||  (N(2)  +  zf  ‘  <H|  <  Vy  6  L2(D1) 

where  0  <  0  <  1 . 


Proof:  It  follows  immediately  from  Theorem  2.21,  page  330  of  Kato  [17]. 
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Definition  4.10.  Let  P*  be  the  pi'ojection  on  the  subspace  of  the 
functions  of  L2QR)  that  have  support  on  u  J2e^. 

Definition  4.11.  Let  P*  be  the  projection  on  the  subspace  of  the 
functions  of  L  QR)  that  have  support  on  IR\U*  where 

U*(t')  =  {y  i  y  |  <  VJ !  (e) }  U  {>'  ly-yj  <  u2(e)}  u  (y  |y-y2|  <  p3(;)} 

Let  us  now  choose 

(4.99)  Me)  =  £~61  0  <  6,  <  l/3 

p,(c)  and  u3(c)  will  remain  determined  by  the  equations  (3.28),  (3.29). 

Theorem  4.12.  Let  px(c)  be  given  by  (4.99)  and  y2(c),  u3(c)  be 
determined  by  (3.28),  (3.29).  Then  for  0  <  e  <  e„  we  have  the  follow¬ 
ing  estimates: 

(4.100)  ||(G^  *  01.)d-P*)K  =  0 

(4.101)  l|0:*(G2e-0i.)P*:|  <  constant 

(4.102)  1|  0“ VP* il  <  constant  c^1 

(4.103)  ||  (U  -G1£J  (I-P*)  I  <  constant  e*  351 

(4.104)  ||U‘l(U  -U  )p!i|  <  constant 

(4.105)  1  G  ” 1 P*  il  ^constant  c‘51 

Proof :  The  estimates  (4.100),  (4.101),  ...  ,  (4.105)  can  be  proved 
has  the  corresponding  estimates  (4.40),  (4.41),  ...  ,  (4.45)  of  Theorem 


45 


Let  us  first  make  precise  in  which  sense  is  approximated 

by  M;  ' ,  Nr  ’  and  N£  is  approximated  by  ,  fr  1 . 


Hie  or  cm  5_.  1 .  There  exist  constants  A,  zu  >  0,  £„  >  0,  >  0 

such  that  for  z  >  z0 ,  0  <  e  <  c0  we  have 


§5.  The  behavior  as  e  -*-  0  of  eigenvalues  and  eigenvectors  of  M  ,  N£> 


(5.1) 

||  (M^+z)'1  - 

(5.2) 

II  (M f  )  +  z)_1  - 

(M^1)+z)  ~ 

(5.3) 

||  (*^1)+z)  1  - 

(M.+Z)’1!! 

(5.4) 

||  (N(j!)  +  z)  - 

(N  -*-z)  " 1 1| 

L 

(5.5) 

1  (N^^+z)*1  - 

(N<0+c)_ 

(5.6) 

||  (N(1)+z)_1  - 

(N  +Z)"1  || 

L 

L 

Proof : 

The  proof  of  (5.1), 

(5.2),  (5 

Theorem 

4.6,  reasoning  as  in 

1  saacson 

A.-6! 


proof  of  (5.4),  (5.5),  (5.6)  follows  from  Theorem  4.9  and  Theorem  4.12. 

Let  us  remark  that  (5.1)  and  (5.4)  say  that  the  resolvent  of 
M  converges  to  the  resolvent  of  and  the  resolvent  of  N  con- 

<_  t  e 

verges  to  the  resolvent  of  N1, '  •*  as  >  -  0.  In  section  3  we  have 


h"*  »  ■*'  «  m  M  *  »'*  .'*  .  *  A  •  *  ”  *  '  •  ’  .  *  •  ‘  -  V  *  »  •  *  *  ’.■  *  . 

*  -  •  *  a  *  V -  h  •  .  *  m  *  .  *  .  •  i  *  . 


"  ,»  *  r.*  «*. 


iCflONMaKt 


(2)  (2) 

studied  the  eigenvalues  and  e i gen funct ions  of  PL  and  ;  here 

we  will  see  the  consequences  of  (5.1),  (5.4)  on  the  eigenvalues  and 
of  M  ,  N  . 

C  € 

(2) 

Let  P  (S)  and  P  (S)  be  the  spectral  projectors  of  M 

•  C  €  £ 

and  associated  with  the  Bore!  set  S  c  (C. 

The  eigenvalues  of  (3.17),  (3.20)  when  c  0  are  given 

by 

(5.7)  =  8a?n  +  0( r:)  n  =  0,1,2,  ... 

(5.c0  .X°  =  4'-t:(n  +  l)  +■  ('(c2)  n  =  0,1,2,  ... 

ne 

( cee  Pig.  9) . 


4 ex ?  8'i:  1  2-i 7  1 6ci 2 


Fig.  9 

We  remind  here  that  '  has  multiplicity  2  and  X°  has  multiplicity 


(5.9) 

and 


Ck(r)  =  (z 


z  -  4u 2  k  I  =  r) 


k  =  0,1,2,  ... 


(5.10) 


Dk=  (z 


|z-4a2k|  <  r} 


k  =  0,1,2, 


with  r  <  a2 ,  and  let: 


(5.11) 


then 


1  ([>  (z-M(2>}-1dz 


2it  i 


Ck(f) 


(5.12) 


1>(2)(D0)  =  p(2)({A;-e)) 


for  e  small  enough 


(5.13) 


if  >(Dk)  - 


l\f  ^((A.  _)  k  odd 

e-  K“  1  j  t. 


P.  ^((A.  ,}U  {a '  }  k  even 

~2* 


for  e  <  i-k  (see  Fig.  9).  We  remark  that  ek  cannot  be  chosen  inde¬ 
pendent  of  k. 


Theomn_  5.2 .  There  exists  ek  >  0  such  that  for  all  z  6  Ck(r)  and 
all  0  <  t_  <  t  k . 


(5.14'  (z  -  M^) ~1  exists 
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(5.151  sup  1  (z-M  l'1  -  (z-M(;))-1:|  <  constant  c  £- 

„  ,,  f  .  e  c 

:t(k(r) 

Proof :  It  follows  from  Theorem  5.1  and  the  known  properties  of  the  spec¬ 
trum  of  \  rearranging  the  proof  of  Theorem  4.1  of  Isaacson  [2]. 


Theorem  5.5 .  Fo r  k  =  0 , 1 , 2 ,  . . .  we  have 

lim  11  P  CD.)  -  P^2)  CD. )  ;|  =  0 
e-0  e  K  c  K 

Moreover  for  all  e  sufficiently  small  possesses: 

(il  two  distinct  eigenvalues  a  - (cl  5  0,  u’(-;)  >  0  such  that: 


(a .16) 

1  in 
£-0 

elf-)  =  a  ;  (- )  =  0 

( i i )  when  k 

is  odd 

one  eigenvalue  Mk(c)  such  that 

(5.17) 

1  in 

L-0 

’;k(  ')  =  4  x'k  k  =  1 ,5,  . . . 

( i  i  i)  when  k 

is  even  three  distinct  eigenvalues  ) > 

such  that: 

(5.'6) 

1  im  a 
£-0 

k(  J  =  lim  ;.)(•;)  =  1  im  lP(0  =  4a:k 

N  c-0  £-*-0 

k  =  2,4,  ... 

Proof:  From 

(5.15) 

of  Theorem  5.2  we  have: 

(5.io)  !  P  (Dk)  -  pf}(Dki:!  =  llwlp  f  ( (=-M^ ) " 1  -  (r-M5*l) ) ' 1  ]d="i 

C.  (r) 

*  K 

.  * 1 
^  constant  r  •  ™ 


So  that  for  c  sufficiently  small 


(5.20)  dim  P  (D  )  =  dim  P(2)(0J 

G  K  G  K 

The  remaining  part  of  Theorem  5.3  follows  from  (5.12),  (5.13),  (5.7), 
(5.8). 

Let  us  now  establish  the  results  announced  in  section  2. 

Theorem  5.4.  Let  0  =  -XQ(c)  <  -  XL  (i.)  <  -  A2  (e)  <  ...  be  the  eigen¬ 
values  of  M  .  Then: 

c 

(5.21 )  lim  -  X1 (e)  =  0 
c->0 

(5.22)  lim  -  A  (e)  =  4a2(2n+l)  n  =  0,1,2,  ... 

t_-*0 

(5.23)  lim  -  A  (t)  =  1 im  -  A  (c)  =  lim  -  A,  (e)  =  8a2 (n+1) 

t.-'-O  c-H)  c-+0 

n  =  0,1,2,  ... 

Proof:  Let  SR  =  (z=x+iy  | -1  ^  x<  4a2k+Za2  ,-l  <  y  <  -1 }  k  =  0,1 ,  ...  .  By 

estimates  analogous  to  the  ones  of  Theorem  5.2  it  is  possible  to  show 
that 

Hm  ||P  (Sk)  -  Pr(2)(S,)||  =  0 
e-0  K  c  K 

That  is  for  c  sufficiently  small 

d  im  P  (S.  )  =  dim  P^  (S,  ) 

l  K.  t  K 

theorem  5.4  follows  now  from  Theorem  5.3. 

(2) 

A  straightforward  computation  shows  that  the  eigenvalues  ol  N; 


when  t 


0  are  given  by: 


(5.24) 

-'n. 

=  c(2n+l)  -  c  +  0(-  ~ ) 

n 

=  0,1,2, 

(5.23) 

-x(:) 

nc 

=  Icjfdn+l)  -  cx  +  C(-) 

n 

=  0,1,2, 

(5.26) 

-(3) 

-  A 

n>; 

=  c;  (2n+l)  -  cz  +  0( •■*) 

n 

*  0,1,2, 

:  m 


where  c  =2axi.x;  ,  Cj  =  2axi(Xi-X2)  <  0,  c2  =  2ax;(x^-xi)  where  xi.x^ 
are  given  in  (i)  of  Proposition  2.2. 

__  QQ 

Let  {-X  }  be  the  set  obtained  reordering  the  numbers  of 
n  n  =  o 

U,  -  lc(Vl)-c);.,,  E;  -  i|cl!(2n*l)-c1!",)  and  E,  -  icJ’n.U-cp^ 

in  such  a  wav  that  -X  <  -X  n  =  0,1,  ...  .  Moreover  if  a  number 

appears  in  more  than  one  IX  i  =  1,2,3  it  will  appear  a  corresponding 

number  of  times  in  { -7  }'  ,  in  particular  since  zero  appears  in  Ei 

n  n=)  '  - 

and  I: ;  we  will  have  -X,  =  =  0. 


rheorem  3 ,  J.et  0  =  U)  •  (•_)  < 

Then 


be  the  eigenvalues  of  \ 


(3.27) 


lim  -a  (c) 

.  n 

•.  -0 


Proof:  The  proof  can  be  obtained  from  (5.24) ,  (3.23),  (5.2o)  rearranging 

the  proofs  of  Theorem  3.2,  Theorem  5.3,  Theorem  3.4. 

We  remark  that  when  a  certain  value  appears  more  than  once  in 

(  -T  ■  this  corresponds  to  asymptotic  eigenvalue  degeneraev  for  N  . 

n  n  = '  '  ■  c 

Since  =  0  we  have 


All  the  remaining  {-A  }  are  distinct  if  —  is  irrational, 

b  n  n=2  X2 

X  l  i  ' —  i  ^ 

if  —  is  rational  l -A  }  ,  contains  values  that  appear  oni/  once 

Xj  n  n=2  11/ 

and  values  that  appear  three  times. 

That  is,  there  are  eigenvalues  of  that  remain  isolated  when 

i  *■  0  and  eigenvalues  that  have  asymptotic  multiplicity  three  when  t_  ->■ 
We  have  already  observed  this  phenomenon  in  the  study  of  M  . 
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§6.  The  estimate  of  the  first  nonzero  eigenvalue  of  M  and  X  . 

e  e 

In  section  5  it  has  been  shown  that 

(6.1)  -AoOO  =  -XoOO  =  0  Ve  ji  0 

(6.2)  lim  -A^e)  =  lim  -Xx  (e)  =  0 

e-*-0  e-<-0 

where  -Xo(£),  -Ax(£)  >  0  are  the  first  two  eigenvalues  of  M£  and 

•X0(e),  -Xx(e)  >  0  are  the  first  two  eigenvalues  of  N  . 

In  section  2  it  has  been  shown  that  the  eigenfunctions  correspond 
ing  to  -X0(s)  and  -Xu  (e)  are  respectively: 

;  -  f .  .  ,  , 

(0.3)  V,  (y)  =  d2  e  le"  - 

0  £ 

and 

(6.4)  va(y)-3Je 

where  flff2  are  given  by  (2.15),  (2.14),  f i _ ,  f,  by  (2.4)  and 


(6.5) 

(6.6) 


r+u°  -f 


d  = 


l-/z 


l  J. 


dv 


l-i 


£ 


cT 


£ 

n 


c 

£ 


are  normalization  constants  such  that  ||  v0  [|^2  ^  =  II  v o  !i l 2  OR ) 
c_ ,  c  are  given  by  (2.11). 


=  1  and 
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Using  the  Ravleigh-Ritz  principle  ([6],  page  78,  Theorem  XIII. 2) 
we  want  to  estimate  the  quantities  -A,(e)  +  \3(e)  and  -X^c)  +  \0(c) 
as  :  -  0  that  is  the  first  nonzero  eigenvalue  of  M_  and  N  . 

The  same  problem  for  the  Fokker-Planck  operators  corresponding 
to  M  and  X  and  for  some  more  general  Fokker-Planck  operators  has 
been  considered  by  Matkowsky-Schuss  in  [10] . 

Matkowsky-Schuss  in  [10]  used  the  technique  of  matching  asymp¬ 
totic  expansions.  The  results  obtained  here  using  the  Ravleigh-Ritz 
principle  are  contained  in  the  ones  obtained  by  Matkowsky-Schuss  in  [10] 
but  are  derived  in  a  more  elementary  way. 


Theorem  6.1.  Let  -X3(c.),  -\1(c),  be  as  above.  Then  as  c  -  0 

we  have 

-  x1* 

(6.7)  0  <  -\,(£)  +  \0(e)  £  -X^c)  constant  e 


Proof :  From  the  Rayleigh-Ritz  principle  ([6],  page  78,  Theorem  XIII. 2) 

we  have 


(6.8) 


0  <  -X,  (e)  +  X 3  (e) 


<g  (1R) 

<g,g>LJ(TR) 


where  g  6  Id HR)  is  any  function  orthogonal  to  v0  (given  by  (6.5)) 
that  belongs  to  the  domain  of  M  as  a  form. 

Since  v.  is  an  even  function  let  us  choose 
(6.0)  g  =  uv 

o 

where  u(y)  =  -ul-v)  is  an  odd  function  such  that  u  6  I.  HR)  and 
4^  g  I.'®)  where  4^  is  the  distributional  derivative  of  u. 

uV 
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The  function  g  is  orthogonal  to  v  and  belongs  to  the  form 


domain  of  M  . 


Ke  have 


(6.10)  <8.^* jo  " 


uvo[-  +  V  !uv0dy  = 


=  ...  {  [&  (Wb)]  +  veu2y-:}  d>'  = 

=  ...  {  ,3y]  v°  +u2(df]  +  2u  37  volKr  +  Veu2v^jdy 


+“  fdu) 2  2  , 

td^j  Vc  d>' 

-00  '■  J 


Since 


(6-u) 


■  d'„=  dv»i*.  -  ri,  du  *•.,  d\  i 
. v°Jyiu  dT]d>  '  '[„{“u  5?  Vj‘dC  *  u  v.  -dTrK 


and  MtV«  *  '  Syf-  *  VEv«  *  0. 
So  that 


(6.12)  0  <  -*,(£)  +  A0(c)  =  -Xx(c)  < 


f+-° '  ,  '  2 

du1  2  , 

Ja?j  v«d>' 


u2v0dv 


Let  us  choose 


V 


f-T-OO 

v2u2dy 

£->0 


r  '  e2  2  /T 

lim  |  c  e  u2(  —  x)  Ax 

£-*■0  E 


In  fact  in  the  sense  of  distribution 


(6.173 


'  ~r  I 

lim  c  e  =  -_(^(x-a)  +  6(x+a)) 

c-0 


where  6(*)  is  the  Dirac's  delta. 

Theorem  6.1  now  follows  from  (6.13),  (6.14),  (6.15),  (6.16). 

We  remark  that  since  a4  =  f x  (0)  -  fx  (a)  the  estimate  (6.13) 
agrees  with  the  one  of  Matkowsky-Schuss  [10]. 

Theorem  6.2.  Let  -\3  (s) ,  -^(c),  be  as  above.  Then  as  c  -  ( 
wo  have 


(6.18) 


0  <  -\1(c)  +  A0(c)  =»\1(t:)  <  constant  e 


'  ^r(f2(x1)-f2(x2)) 


where  x,  and  x,  are  given  in  Proposition  2.Z  (i)  (see  Fig.  2) 


Proof:  Reasoning  as  in  the  proof  of  Theorem  6.1  we  have 


riD* 


vodv 


(6.19)  0  <  -AJc)  ♦  X0(c)  =  -Yx(£)  < 


h2v^dy 


>'>-  .'-tvvvv;  v--:vv;..'N*y:*.v» -sv.sv: •  - 

-  M  -  »  -  .1  ■  _  »  -  -  -  --  -  - 


where  g  =  h  v0  6  L2(R)  is  a  function  orthogonal  to  v0  such  that 
h  €  L°°  OR)  and  ^6  L  QR) . 

Let  us  choose 

(6.20)  h  -  u  -  <  u  vfl ,  vQ  '"’l2  (]R) 

where 

y  >  yx  +  1 
ly-yj  <  i 
y  <  yi  -  i 


Reasoning  as  in  Theorem  6.1  it  can  be  shown  that: 

ao  ,  2  -  -JL_  f  fX  1 

dh  — 2  c2.  X2t'AlJ 

(6.22)  v0  dy  <  constant  e  e 

j  -  00  '  ■ 

Moreover 


f+°° 

+CO 

■  r+oo  2 

(6.23) 

h2v02dy  =  u2v2dy  - 

u  v2dy 
»  /_00  * 

and 

J_oo 

oo 

/*+«> 

I  u2v02dy  =  1 

(6.24) 

lim 
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(6.25) 


lira 

£-H) 


i»+00 

I  u  v*  dy  +  1 

ao 


2  f2(x2) 

e  “ 


/  fl'fJ) 

*  fycxj) 


Theorem  6.2  now  follow-s  from  (6.19),  (6.22),  (6.23),  (6.24),  (6.25). 


§7.  Conclusions 


‘  I 

-  -V  f (x) 

Let  ffx)  6  C 3  OR)  be  such  that  e  6  L1 OR)  Ve  /  0 

;md  suppose  that 

(7.1)  f'(x)  =  0 


has  n  roots  3,  ,32,  ...  ,  3n  such  that 

T.2)  f"(3L)  =  *  0  i  =  1,2,  ...  ,  n 


that  is  3^,3^,  ...  ,  3^  are  non-degenerate  minimizers  or  maximizers 
of  f . 

Let 


(7.3) 


L.  CO 


Sx- 


i_  f 

3x  i  dx 


the  Fokker-Flanck  operator  associated  to  f. 

Proceeding  as  in  section  2  the  study  of  the  spectrum  of  (7.3)  can 
be  reduced  to  the  study  of  the  spectrum  of 


M) 


K;  *  -  3?r  ♦ 


on  L'flR)  where  W  (y)  is  given  by  (2.7). 

/ T 

Let  y.  =  —  3^  i  =  1,2,  ...  ,  k  a  straightforward  computation 
shows  that  as  e  -  0  IV  (y)  approaches  n  decoupled  harmonic  oscillators 
potentials  ( a: (V-v.)  ‘  -  ]a.. 

■  i  •  •  i  i 

.So  that  we  expect  the  spectrum  of  H  to  approximate  the  spectrum 
of  n  decoupled  harmonic  oscillators  •!  =  Vt.!(2k+l)  +  1*- , 
i  -  i  ...  n  and  k  *  '>,1  ,2 . 
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In  particular  if  f  has  m  (<n)  minimizers,  that  is  a.  >  0 
j  =  1 ,2  ,  ...  ,  m  we  expect  the  eigenvalue  zero  of  H  (or  L  )  to  have 
asymptotically  multiplicity  m  when  e  ->  0. 


References 


[1]  C.  J.  Thompson,  M.  Kac:  "Phase  transition  and  eigenvalue  degeneracy 

of  a  one -dimensional  anharmonic  oscillator"  Studies  Applied  Math. 
48,  (1969),  257-264. 

[2]  D.  Isaacson:  "Singular  perturbations  and  asymptotic  eigenvalues 

degeneracy"  Comm.  Pure  Applied  Math.  29_,  (19”6)  ,  531-551. 

[3]  D.  Isaacson,  D.  Marchesin:  "The  eigenvalues  and  eigenfunctions 

of  a  spherically  symmetric  anharmonic  oscillator"  Comm.  Pure 
Aplied  Math.  31,  (1978),  659-670. 

[4]  E.  Harrell:  "On  the  rate  of  asymptotic  eigenvalue  degeneracy" 

Comm.  Math.  Phys.  60,  (1978),  73-95. 

[5]  E.  Harrell:  "Double  wells"  Comm.  Math.  Phys.  1S_,  (1980),  239-261. 

[6]  M.  Reed,  B.  Simon:  "Methods  of  modem  mathematical  physics" 

vol.  IV,  Academic  Press,  New  York,  1978. 

[7]  J.  Glimm,  A.  Jaffe:  "Quantum  physics:  a  functional  integral 

point  of  view"  Springer-Verlag ,  New  York,  1981. 

[8]  Z.  Schuss:  "Singular  perturbation  methods  for  stochastic  differen¬ 

tial  equations  of  mathematical  physics"  SIAM  Rev.  _22,  (1980), 
119-155. 

[9]  S.  Chandresekhar :  "Stochastic  problems  in  physics  and  astronomy" 

in  Selected  Papers  on  Noise  and  Stocastic  Processes,  N.  Wax 
Editor,  Dover,  New  York,  1954. 

[10]  B.  J.  Matkowsky,  Z.  Schuss:  "Eigenvalues  of  the  Fokker-Planck 

operator  and  the  approach  to  equilibrium  for  diffusions  in 
potential  fields"  SIAM  J.  Appl .  Math.  40,  (1981),  242-254. 


61 


62 


[11]  F.  Aluffi-Pentini,  V.  Parisi,  F.  Zirilli:  "Global  optimization 

and  stochastic  differential  equations"  submitted  to  Journal 
of  Optimization  Theory  and  Applications. 

[12]  B.  Simon:  "Coupling  constant  analyticity  for  the  anharmonic 

oscillator"  .Annals  of  Physics  58_,  (1970),  76-136. 

d  2 

[13]  F.  Zirilli:  "Some  observations  on  the  operator  H  =  + 

m2x2  +  Journal  Mathematical  Physics  JJ5,  (1974),  1202. 

[14]  E.  C.  Titchmarsh:  "Eigenfunction  Expansions"  Part  I,  Oxford 

University  Press,  London,  1962. 

[15]  S.  Fliigge:  "Rec’nenmethoden  der  Quantentheorie :  l  Teil  Elementare 

Quant enmechanik"  Springer -Verlag ,  Berlin,  1947. 

[16]  J.  Weidmann:  "Linear  operators  in  Hilbert  spaces"  Springer-Verlag, 

New  York,  1980. 

[17]  T.  Kato:  "Perturbation  theory  for  linear  operators"  Springer- 


Verlag,  New  York,  1966. 


APPENDIX  A3 

Test  problems  for  global  optimization  software 

by  1- .  Aluf  f i -Pent in i  ,  V.  Parisi  ,  F.  Zirilli 

(submitted  to  ACM  Transactions  on  Mathematical  Software). 
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Pr  ob 1 ea  14 

A  function  with  three  ill-conditioned  ainiaa,  a  =  10 

a)  function:  as  in  probl.  10 

5 

b)  paraaeter  values:  a  =  10,  b  =  1/a 

c) ,  d) ,  e)  :  as  in  problea  10 

f)  aimaa  in  the  region  0  :  two  global  ainiaa  at 

( x , y )  =  i(0,  14.94511),  where  f  =  -24776.51834, 
and  another  local  aimaua  at 
( x  ,  y )  =  (0,  0) ,  where  f  =  0 

g) ,  h),  l)  :  as  in  problea  10. 

Problea  15 

A  function  with  three  ill-conditioned  ainiaa,  a  *  10^ 

a)  function:  as  in  probl.  10 

b )  par aaeter  values:  a  *  106,  b  *  1/a 

c) ,  d),  e)  :  as  in  problea  10 

f)  ainiaa  in  the  region  D  :  two  global  ainiaa  at 

( x , y )  *  i(0,  26.58678),  where  f  *  -249293.01826 
and  another  local  ainiaua  at 
(x,y)  =  (0,  0),  where  f  =  0 

g) ,  h),  i)  :  as  in  problea  10. 


Problea  16 

Gol dstei n-Pr i ce  function 
a )  function: 

fix,/)  -  g ( x , y )  h  ( x , y ! 

*■ > 

with  gix,y)  =  1  +•  u  (36  -  20u  *■  3u  i 
n  ’  =  30  *  /  13  -  lav  *  3v  1 


.•)  n  e  r  e 


ana 


Problem  11 

A  function  with  three  ill-conditioned  minima,  a  =  100 

a)  function:  as  in  probl.  10 

b)  parameter  values:  a  =  100,  b  =  1/a 

c) ,  d),  e)  :  as  in  problem  10 

f)  minima  in  the  region  D  :  two  global  minima  at 

lx,/)  3  i'0,  2.60891),  where  f  *  -18.05870 
and  another  local  minimum  at 
( x  ,  y  )  =  ( 0 ,  0),  where  f  =  0 

g) ,  h),  i)  :  as  in  problem  10. 


Problem  12 

A  function  with  three  ill-conditioned  minima,  a  =  1000 

a)  function:  as  in  probl.  10 

b)  parameter  values:  a  3  1000,  b  =  1/a 

c) ,  d),  e)  :  as  in  problem  10 

f)  minima  in  the  region  D  :  two  global  minima  at 

(x,y)  =  t(0,  4.70174),  where  f  =  -227.76575 
and  another  local  minimum  at 
(x,y)  3  (0,  0),  where  f  =  0 

g) ,  h),  1)  :  as  in  problem  10. 


Problem  13 

A  function  with  three  ill-conditioned  minima,  a  =  10000 

a)  function:  as  in  probl.  10 
b!  parameter  values:  a  =  10000,  b  =  1/a 
c),  d),  s'i  :  as  in  problem  10 

f )  minima  in  the  region  D  :  two  global  minima  at 
;>:,/)  =  t(0,  8.37401),  where  f  -  -2429.4  1  477 
and  another  local  minimum  at 
(:■:,’/)  =  ( 0 ,  0 )  ,  where  f  =  0 
g  > ,  h )  ,  i )  :  as  l n  o r o b i e m  10. 


Problem  8 

Two-dimensional  penalized  Shubert  function,  p  =  0.5 

a)  function:  as  in  probl.  7 

b)  parameter  values:  as  in  probl.  7,  except:  £  =  0.5 

c) ,  d),  e)  :  as  in  probl.  7 

f)  minima  in  the  region  D  :  general  behavior  as  in  probl.  7 

but  17  out  of  the  18  global  minima  become  non-global, 
ving  a  single  global  minimum  at 
(x,y)  ~  (-1.42513,  -0.80032)  with  the  same  value  for  f. 

g)  ,  h) ,  i)  :  as  in  probl.  7. 

Problem  9 

Two-dimensional  penalized  Shubert  function,  )J  =  1 

a)  function:  as  in  probl.  7 

b)  parameter  values:  as  in  probl.  7,  except:  p  *  1 

c)  ,  d) ,  e)  :  as  in  probl .  7 

f)  minima  in  the  region  D  :  same  behavior  as  in  problem  8 

g) ,  h),  i)  :  as  in  probl.  7. 


Problem  10 

A  function  with  three  ill-conditioned  minima,  a  =  10 

a)  function: 

7  7  7  7  7  r>  7  A 

f(x,y>  =  ax"  +  y"  -  (x  +  y"  )“  +  b(x"  +  y"  ) 

b)  parameter  values:  a  =  10,  b  =  1/a 

c )  d : mensi on :  N  =  2 

d)  region:  D  =  {  Ixl  ±  10,  lyl  i  100  1 

e)  penalization:  none 

f)  minima  in  the  region  D  :  two  global  minima  at 

(x,y)  =  i  ( 0 ,  1.38695),  where  f  =  -0.40746 
and  another  local  minimum  at 
(x,y)  =  (0,  0),  where  f  =  0 

g)  initial  point:  ( x  ,  y  )  =  (0,  0) 

h!  source:  suggested  by  one  of  the  authors  (F.Z.) 
i  notes:  as  :n  problem  2;  the  problem  becomes  more  ill- 
conditioned  as  a  becomes  larger. 
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Problea  7 

Two-di aensi onal  penalized  Shubert  function,  j)  =  0 


a )  function: 

2  2 

f  ( x  ,  y )  *  g  ( x )  g  ( y )  +•  p  C  ( x  -  a)  +  (y  -  b)  3 

where  g  is  the  function  defined  as  f  in  probl.  3,  a) 

b)  paraaeter  values:  j)  =  0 

a  =  -  1 . 4251284283197609708 ,  b  =  -0.30032110047197312466 

c)  diaension:  N  =  2 

d)  region:  D  =  {  lx!  6  10,  I y I  6  10  } 

e)  penalization:  w  <  x  ,  y )  =  u(x,  10, 100,2)  +  u ( y , 10, 100,2) 

f)  aimaa  in  the  reqion  D  :  13  global  ainina,  at 


m  aa 

i  n 

the  region 

D  :  18 

<  * » y  > 

= 

(-7.08350, 

-7.70831) 

( x  ,  y ) 

3 

(-0.80032, 

-7.70831) 

(x  ,y) 

3 

(  5.48286, 

-7.70831) 

(x,y) 

3 

(-7.70831, 

-7.08350) 

<x,y) 

3 

(-1.42513, 

-7.08350) 

(x,y) 

3 

(  4.85805, 

-7.08350) 

(x  ,y) 

3 

(-7.08350, 

-1.42513) 

(x  ,y) 

3 

(-0.80032, 

-1.42513) 

(x,y> 

= 

(  5.48286, 

-1.42513) 

( x  ,  y ) 

3 

(-7.70831, 

-0.80032) 

(x  ,y) 

3 

(-1.42513, 

-0.80032) 

(x,y> 

3 

(  4.85805, 

-0.80032) 

(x,y) 

a 

(  7.08350, 

4.85805) 

(x,y> 

3 

(-8.00320, 

4.85805) 

(x,y) 

3 

(  5.48286, 

4.85805) 

!x,y) 

3 

(-7. 70831 , 

5.48286) 

( x  ,  y  ) 

3 

(-1.42513, 

5.48286) 

(  x  ,  y ) 

3 

(  4.35805, 

5.48286) 

where  f 


-186.73091 


and  742  other  local  aimaa. 


g)  initial  point:  (x  ,  y  !  -  !0,  •)) 

o  o 

h i  source:  r ef .  C53 

i  notes:  outside  D  the  oenalned  function  f  +  w  has  a 
small  numoer  of  non-giobal  minima  (near  to  D  i  : 
the  point  1  a ,  b  i  is  one  of  the  13  global  minimi- 

zers  of  g  :  g  <  v  '  :n  the  region  0  . 
Three-dimensional  diots  of  f  are  given  in  [S3. 
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Problem  5 

A  function  with  a  single  ran  of  local  minima 

a)  function: 

f(x,y)  3  ax“  +•  (1/2)11  -  cos(2x)l  <■  y2 

b)  paraaeter  values:  a  3  0.05 

c)  dimension:  N  =  2 


d) 

region: 

D  3 

{  -15  £ 

lx  1 

£  25, 

-5 

£  1  y  1  £ 

e) 

penal i z 

ati on : 

none 

f ) 

minima 

in  the 

region 

D  : 

a  global 

minimum 

<x,y> 

3  (0 , 

0) ,  where 

f  3  0 

and  six 

other  local 

minima 

at : 

(x  ,y) 

=  t  (2 

.98978, 

0)  , 

where 

f  3 

0.46981 

!x  ,y) 

3  t  (5 

.96370, 

0)  , 

where 

f  3 

1.97693 

( x  ,  y ) 

=  t  ( 8 

.37846, 

0), 

where 

f  3 

4.21128 

g> 

initial 

point 

:  (x  , 

o ' 

V 

3  (-3, 

0) 

h)  source:  suggested  by  one  of  the  authors  (F.Z.) 

i)  notes:  the  starting  point  is  very  close  to  a  non-global 

■iniaizer . 


Problem  6 

Six-hump  camel  function 

a)  function: 

f  ( x ,  y )  *  (4  -  2.1  x2  +  x*/3)  x2  *■  xy  (-4  *  4y“)  y2 

b)  paraaeter  values:  none 

c)  dimension:  N  3  2 

d)  region:  D  3  (  Ixl  £  3,  lyl  £  2  } 

e)  penalization:  none 

f)  minima  in  the  region  D  :  two  global  minima,  at 

( x , y )  3  t<-0. 089842,  0.71266),  where  f  3  -1.03163 
and  four  other  local  minima,  at 
(x,y)  =  t  <  —  l . 70361,  0.79608),  where  f  =  -0.21546,  and 
!x,y)  =  t(l. 60710,  0.56865),  where  f  3  2.10425 

q)  initial  point:  (x  ,  v  )  =  (0,  0) 

o  o 

h)  source:  ref.  [1],  quoted  by  [53 

i ;  notes:  in  D  the  function  f  nas  2  maxima  and  7  saddle- 
pomts.  Three-dimensional  olots  of  f  are  given  in  [53. 


Problem  3 

One-dimensional  penalized  Shubert  function 


a)  function: 

5 

f  (  X  )  a  ^ 

k  =  l 


k  cos  C  (  k  + 1 )  x  ♦>  k  ] 


b)  parameter  values:  none 

c)  dimension:  N  a  \ 

d)  region:  D  =  (  I  x  I  s  1 0  } 

e)  penalization:  w(x)  a  u (x , 10 , 1 00 , 2) 

f)  minima  in  the  region  0  :  three  global  minima  at 

x  *  -7.70031,  -1.42513,  4.85806,  where  f  =  -12.87088 
and  16  other  local  minima 


g  >  initial  point:  xq  *  0 

h)  source:  ref.  15  of  C5] 

i)  notes:  the  function  f  is  periodic  (period  2x). 


Problem  4 

A  fourth-order  polynoeial  in  two  variables 
a)  function: 

4  o  •? 

f  <  x )  ax  /4  -  x“/2  +  ax  +  y“/2 

o )  parameter  values:  a  ~  0. 1 

c)  dimension:  N  =  2 

d )  region:  0  =  (  i x i  i  10,  I y I  ±  10  } 
e  /  penalization:  none 

f)  minima  m  the  region  D  : 

two  minima,  both  for  y  =  0,  as  in  problem  1 

3 )  initial  point:  i x  ,  v  !  =  !  1 ,  0) 

o  o 

h >  ,  i  i  :  as  in  p r o b 1  .  1 . 


APPENDIX  1.  The  test-problem  list 


Problem  1 

A  fourth-order  polynomial 

a)  function: 

f (x )  3  x*/4  -  x2/2  ♦  ax 

b)  parameter  values:  a  *  0.1 

c)  dimension:  N  3  1 

d)  region:  D  3  {  I x I  £  10  } 

e)  penalization:  none 

f)  minima  in  the  region  D  :  a  global  minimum  at 

x  *  -1.04660,  where  f  3  -0.35239, 
and  another  local  minimum  at 
x  3  0.94565,  where  f  3  -0.15264 

g)  initial  point:  xq  3  1 

h)  source:  suggested  by  one  of  the  authors  (F.Z.) 

i)  notes:  the  initial  point  is  very  close  to  the  non-global 

mi ni mi zer . 


Problem  2 

Goldstein  sixth-order  polynomial 


a)  function: 

f(x)  3  x6  -  1 5x 4  +  27x2  ♦  250 

b)  parameter  values:  none 

c)  dimension:  N  =  1 

d)  region:  D  =  (  1:1  i  4  ! 

e)  penalization:  none 

f)  minima  in  the  region  D  :  two  global  minima  at 

•:  =  t3,  where  f  3  7, 

and  another  local  minimum  at 
•:  3  0,  where  f  =  250 

a  .*  i  n  i  1 1  a  1  point:  x  3  0 

o 

n :  source:  rot.  6  of  IS] 

i:  notes:  the  starting  point  is  exactly  at  the  non-global 
minimizer.  midway  between  the  global  ones. 
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The  subroutine  GLQMTF  contains  a  total  of  about  430 
statements  (including  some  160  coaaent  lines).  This  aaounts 
on  the  ASCII  FORTRAN  compiler  (without  optimisation  option, 
version  10R1A)  of  the  UNIVAC  EXEC  B  operating  system  (level 
37R2C)  to  a  storage  requirement  of  about  1040  (36-bit)  words 
for  the  instructions  and  about  560  words  for  the  data. 

The  corresponding  approximate  data  for  the  subroutine 
GL0I1IP  are  330  statements  (including  140  coaaent  lines),  and 
350  and  35  words  for  instructions  and  data. 


4.  Conclusions 


Me  have  provided  an  extensive  set  of  test  problems  (inc¬ 
luding  the  FORTRAN  coding)  to  be  used  for  testing  global  op- 
sation  software. 

The  prospective  user  may  find  it  useful  to  exploit  a  rea¬ 
dy-made  selection  of  fully  coded  test  problems  of  known  pro¬ 
perties,  which  may  save  him  time,  effort,  and  possible  coding 
errors,  while  enabling  a  more  uniform  comparison  with  the  re¬ 
sults  of  other  users. 


The  FORTRAN  subroutines 


i  v  if"  u  j  a  t  r  v  v  •  u  „ «  ;  j 71   u   if""  .  1  j  v  ;  u 1  j  v  j ^  J 
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The  test  problems  described  in  sect.  2  have  been  coded  in 
the  fora  of  two  FORTRAN  subroutines,  GLOHIP  and  GLOHTF  . 

For  a  given  test  problea  the  subroutine  GLQHIP  returns 
the  nuaber  N  of  variables,  the  initial  point  xq  ,  and  the 

observation  region  D  ,  and  the  subroutine  GLOHTF  returns 
the  basic  test  function  f  ,  possibly  penalized  (outside  D  ) 
by  the  penalization  function  w  . 

All  the  coding  is  written  in  FORTRAN  IV  ,  and  aeets  the 
specifications  of  PFQRT  ,  a  portable  subset  of  A.N.S.  FOR¬ 
TRAN  (ref.  Cal) .  The  FORTRAN  iaplicit  type  definition  for 
integers  is  used  throughout;  all  non-integer  variables  are 
double-precision. 

The  call  stateaent  of  GLQHIP  is: 

CALL  GLQHIP  (NPROB ,  N,  XO,  XMIN,  XHAX) 

where 

NPROB  is  the  (input)  nuaber  which  identifies  the  test  prob¬ 
lea  according  to  the  sequence  in  Appendix  l 
N  is  the  (output)  diaension  of  the  problea  (nuaber  of  inde¬ 
pendent  variables) 

XO  is  the  (output)  N-vector  containing  the  suggested  ini¬ 
tial  point  xq 

XMIN  and  XNAX  are  (output)  N-vectors  containing  the  boun¬ 
daries  of  the  observation  region  5)  ,  defined  by 

XMIN ( I )  -  X ( I )  i  XMAX(I)  ,  I  *  l,...  ,N 
The  call  stateaent  of  GLOHTF  is: 

CALL  GLOHTF  (NPROB,  N,  X,  FUNZ) 

where 

NPROB  is  the  (input!  oroblem  nuaber  (see  above! 

N  is  the  (input)  problea  dimension  (must  be  equal  to  the 
value  provided  bv  GLOMIP  ) 

<  is  the  (input)  N-vector  containing  the  point  ■;  at  which 
the  test  function  is  to  be  computed 
CIJNZ  is  the  output!  value  of  the  i  poss  i  b  1  v  penalized!  test 
i  u n c  1 1  o n  at  .<  . 


Therefore  a  tut  problem,  such  as  hi  provide  it  here,  ie 
defined  byt 

a  basic  function  f 
an  observation  region  D 

a  penalization  function  m,  if  needed  (w  ■  0  in  D) 

an  initial  point  x  . 

o 

We  think  that  such  an  arrangement  covers  the  needs  of  a 
Hide  spectrum  of  possible  global  minimization  methods!  a  tru- 

ly  unconstrained  method  Mill  try  to  minimize  f  +  h  in  R  , 
without  exploiting  any  information  about  D  ,  while  a  con¬ 
strained  method  will  try  to  minimize  f  in  D  ,  obviously 
ignoring  w  , 

We  provide  a  set  of  37  test  problems  complying  with  the 
above  format,  with  varying  source,  nature,  and  difficulty. 
A  complete  definition  of  the  test  problems,  together  Nith  so¬ 
me  relevant  information,  it  reported  in  Appendix  1,  where  for 
each  problem  we  givei 

a)  basic  unrestricted  function  f 

b)  numerical  values  of  any  parameter  in  f 

c)  problem  dimension  N  (number  of  independent  variables) 

d)  observation  region  D  ,  which  is  always  in  the  form  of  an 

N-di mensi onal  interval 

D  ■  <  Xmin^  i  x.  4  XmaXj  ,  i  ■  > 

e)  penalization  function  w  (if  any),  which  is  always  defined 

by  means  of  a  standard  penalization  function  u  of  a 


single  real 

variable 

x  (with  a 

>  0,  b  >  0  ) 

u  ( x ,  a ,  b  , 

m )  ■ 

b 

(  Ixl  -  a  )n 

(  Ixl  >  a  ) 

■ 

0 

(  Ixl  a  a  ) 

f)  information 

about 

the 

minima  of  f 

in  D  (location 

global  minimizera  and  corresponding  function  value, 
given  to  at  least  3  decimal  places  and  at  least  3  signi¬ 
ficant  figures,  and  -  whenever  possible  -  analogous  in¬ 
formation  about  the  local  mimmizers). 

g)  initial  point  x 

o 

h )  source 

l)  notes,  if  any. 


2.  The  test  problea  set 


Let  us  consider  the  problea  of  finding  a  global  ainiaizer 
of  a  real-valued  function  f  of  N  real  variables,  i.e.  a 

point  x  in  R^*  such  that  f(x)  a  f  t  x  *  >  for  all  x  in 

In  the  context  of  this  (unconstrained)  global  ainiaiza- 
tion  problea  to  give  a  test  problea  siaply  aaounts  to  give  a 
test  function. 

It  is  however  a  fact  that  aany  of  the  global  ainiaization 
methods  reported  in  the  literature  (see  for  exaaple  Cl]  and 
C21)  only  attempt,  by  their  very  nature,  to  find  a  global  ai- 
niaum  of  the  function  f  restricted  to  a  compact  region  D. 

While  this  may  be  strictly  considered  a  constrained  glo¬ 
bal  ainiaization  problea,  the  only  practical  consequence  for 
the  test-problea  builder  is  that  in  order  to  give  a  test  pro¬ 
blea  for  one  of  the  above  aethods  one  aust  give  a  test  fun¬ 
ction  f  together  with  a  coapact  region  0  . 

As  far  as  the  above  aethods  are  concerned  the  behavior  of 
the  test  function  f  outside  the  region  D  is  clearly  irre¬ 
levant,  and  aay  be  arbitrary. 

Since  however  our  aia  is  to  provide  a  single  set  of  test 
problems  it  is  clear  that,  in  order  to  meaningfully  use  the 
above  problems  also  to  test  and  coapare  the  aethods  attemp¬ 
ting  to  perform  a  strictly  global  ainiaization  (see  for  exaa¬ 
ple  C71),  it  becoaes  necessary  that  the  ainiaization-relevant 
behavior  of  f  be  sufficiently  ’concentrated*  around  the  re¬ 
gion  D  ,  i.e.  the  unrestricted  f  has  all  its  global  ainiaa 
inside  D  ,  at  most  a  saall  number  of  local  ainiaa  outside  D 
and  a  sufficiently  rapid  growth  away  from  D  . 

Since  these  conditions  are  not  fulfilled  by  some  of  the 
test  functions  actually  proposed  by  some  authors  (as  -  for 
instance  in  the  interesting  "oscillating"  problems  in  C51), 
we  have  aOoDted  the  simple  solution  of  "penalizing",  whenever 
needed,  the  original  function  f  outside  D  ,  bv  simply  ad¬ 
ding  to  f  a  penalization  function  w  which  is  identically 
zero  m  u  and  of  sufficiently  rapid  growth  away  from  D  . 

Finally  -  since  some  aethods  need  a  starting  oomt  -  we 
comoiete  our  definition  of  a  test  oroblem  by  providing  an 


1.  Introduction 


The  problea  of  finding  a  global  ainiaizer  of  a  real-v«»- 
lued  function  of  several  real  variables  is  of  considerable 
practical  and  theoretical  interest,  and  aany  algorithas  for 
its  nuaerical  solution  have  been  developed;  see  for  exaaple 
the  two  voluaes  of  collected  papers  [11  and  121,  and  the  sur¬ 
vey  paper  C 3 3 . 

The  situation  appears  to  be  still  in  a  rapidly  evolving 
state,  and  far  froa  the  aore  aature  state  reached  by  the  sia- 
pler  problea  of  finding  a  local  ainiaizer. 

While  this  aakes  it  difficult,  and  perhaps  untiaely,  to 
atteapt  a  systeaatic  classification  of  the  algorithas,  it 
does  not  relieve  us  froa  the  need  of  testing  the  current  al¬ 
gorithas,  both  for  validation  and  for  coaparison. 

The  experiaental  testing  of  the  algorithas  is  usually 
perforaed  by  running  their  software  iapleaentation  on  a  nua- 
ber  of  test  probleas;  a  standard  set  of  test  probleas  is 
clearly  useful,  being  of  verifiable  quality,  and  allowing  a 
fair  coaparison  of  the  algorithas. 

The  iaportance  of  an  extensive  testing  on  a  sufficient 
nuaber  of  carefully  selected  test  probleas  has  been  stressed 
by  Mor*  It  al.  C 4 3 ,  in  the  different  context  of  local  ainiai- 
zation. 

In  the  field  of  global  ainiaization  a  coaaon  set  of  test 
probleas  was  agreed  upon  by  aany  of  the  authors  contributing 
to  C21,  and  is  reported  by  aany  of  then  and  in  Appendix  1  of 
[33.  A  nuaber  of  aore  difficult  test  probleas  were  used  by 
Levy  and  Montalvo  and  are  described  in  C 5 3  and  [63. 

The  present  authors  have  been  involved  in  a  global  aini¬ 
aization  project  [73,  and  in  order  to  test  their  own  algo- 
rithas  they  have  aade  use  of  a  large  set  of  test  probleas, 
including  those  in  C 3 3  and  C53. 

The  purpose  of  this  paper  is  to  make  generally  available 
the  above  set  of  test  probleas,  including  their  software  ia¬ 
pleaentation  in  the  FORTRAN  IV  prograaaing  language. 

In  section  2  we  describe  the  general  pattern  of  the  test 
problea  set,  in  section  3  we  describe  the  usage  of  the  FOR¬ 
TRAN  subroutines  implementing  the  problem  set. 

A  detailed  list  of  the  test  functions  is  reported  in  Ap¬ 
pendix  1,  while  the  complete  FORTRAN  list  is  in  Appendix  2. 
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b)  parameter  values:  none 

c)  diaension:  N  =  2 

d)  reqion:  D  =  (  Ixl  ±  2,  I y I  i  2  1 

e)  penalization:  none 

f)  ainiaa  in  the  region  D  :  a  global  aimaua  at 

(x,y)  =  (0,-1),  where  f(x,y)  =  3 
and  three  other  local  ainiaa,  at 
(x,y)  3  (-0.6,  -0.4),  where  f  3  30 
(x,y)  *  (-1.8,  2),  where  f  3  84 
( x , y )  3  (-1.2,  0.8),  where  f  3  840 

g)  initial  point:  <xq,  y^)  3  (1,  1) 

h)  source:  Appendix  1  in  ref.  C 3 3 

i)  notes:  none. 


Problea  17 

Penalized  Branin  function 

a)  function: 

f(x,y)  *  (y  -  bx^  ♦  cx  -  6)~  +  10  C(1  -  f)  cosx  *•  1] 

b)  parameter  values:  b  3  5. 1/(4**),  c  *  5/x,  f  *  l/(8x) 

c)  diaension:  N  =  2  . 

d)  reqion:  D  3  {  -5  6  x  6  10,  0  i  y  i  15  ) 

e)  penalization: 

w ( x , y )  3  u(x  -  2.5,7.5,100,2)  ♦  u(y  -  7.5,7.5,100,2) 

f)  ainiaa  in  the  region  D  :  three  global  ainiaa,  at 

(x,y)  =  ( -n ,  12.275) 

( x  ,  y )  =  (  it  ,  2. 275 ) 

( x ,  / )  =  (  3 it,  2.  475),  wnere  f  3  0.39789 

g)  initial  point:  ! x  ,  y  !  3  (2.5,  7.5) 

h)  source:  Appendix  1  in  ret.  [31 

l)  notes:  the  function  has  no  non-olodal  ainiaa. 


Problem  18 

Penalized  Shekel  function,  H  =  5 


a)  function: 

f  <  x ) 

where 


c  =  Cc  1  =  CO. 1,0. 2, 0.2, 0.4, 0.4, 0.4, 0.3, 0.7, 0.5, 0.5] 
i 


and 


A  »  Ca  ] 
i  j 


4  4  4  4 

1111 
8  8  8  8 

6  6  6  6 

3  7  3  7 

2  9  2  9 

5  5  3  3 

8  18  1 

6  2  6  2 

7  3.6  7  3.6 


b)  parameter  values:  M  =  5 

c)  dimension:  H  -  4 

d)  region:  D  =  £  0  ±  x.  ±  10,  j  =  i,...,N  } 

e)  penalization: 

N 

w<x)  =  ^  u  ( x  -  5,5,100,2) 


f)  minima  in  the  region  0 


a  global  minimum  at 


x  3  (4.00004,  4.00013,  4.00004, 
and  four  other  local  aimaa, 
x  *  (1.00013,  1.00016,  1.00013, 

x  =  (3. 00190,  6.99833,  3.00180, 

x  3  (5.99875,  6.00029,  5.99875, 

x  3  (7.99958,  7.99964,  7.99958, 


4.00013) , 
at 

1.00016)  , 

6.  99833)  , 
6.00029)  , 

7.  99964)  , 


where  f  * 

where  f  = 
where  f  3 
where  f  3 
where  f  3 


g)  initial  point:  xq^  3  9,  j  3  1,...,N 

h)  source:  Appendix  1  in  ref.  C33 

i)  notes:  the  vectors  of  the  coordinates  of  the 

zers  are  very  close  to  the  first  M  row 
the  aatrix  A  . 


Problem  19 

Penalized  Shekel  function,  H  3  7 


a)  function:  as  in  problea  18 

b)  paraaeter  values:  M  3  7 

c )  ,  d ) ,  e )  :  as  in  problea  18 

f)  ainiaa  in  the  region  D  :  a  global  ainiaua  at 


x 


x 

x 

X 

X 

X 


3  (4.00057,  4.00069, 
and  six  other  local 
3  (1.00023,  1.00027, 
3  (2.00481,  8 . 9° 1 68 , 
3  (3.00091,  7.00064, 
3  (4.99423,  4.99500, 
3  (5.99811,  6.00008, 
3  (7. 99051,  7.99062, 


3.99949,  3.99961), 
ainiaa,  at 
1.00018,  1.00022), 
2.00462,  9.99150), 
3.00037,  7.00010)  , 
3.00606,  3.00683), 
5.99733,  5.99931), 

7.99950,  7.99961  )  , 


where  f  3 

where  f  3 
where  f  3 
where  f  3 
where  f  3 
where  f  3 
where  f  3 
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-10. 15320 

-5.05520 
-2.63047 
-2.68286 
-5. 10077 


M  «ri  n  i  a  i  - 
vectors  of 


-10.40294 

-5.08767 
-1.83759 
-2. 76590 
-3.72430 
-2. 75193 
-5. 10077 


g ,  n )  ,  i)  :  as  in  problem  18 


Problea  20 

Penalized  Shekel  function,  M  *  10 

a)  function:  as  in  problea  13 

b)  paraaeter  values:  11  =  10 

c) ,  d) ,  e)  :  as  in  problea  18 


f ) 

ainiaa  in 

the  region 

0  :  a 

global  ainiaua  , 

at 

X 

3 

(4.00075, 

4.00059, 

3.99966, 

3.99951) , 

where 

f 

3 

-10.53641 

and  nine  other  local 

ainiaa, 

at 

X 

= 

<1.00037, 

1.00030, 

1.00032, 

1.00032) , 

where 

f 

3 

-5. 12848 

X 

= 

(2.00510, 

9.99129, 

2.00491 , 

8.99111) , 

where 

f 

= 

-1.85948 

X 

3 

(3.00127, 

7.00023, 

3.00073, 

6.99969) , 

where 

f 

3 

-2.80663 

X 

= 

(4.99487, 

4.99398, 

3.00756, 

3.00667) , 

where 

f 

3 

-3.83543 

X 

3 

(5.99901, 

5.99728, 

5.99824, 

5.99651) , 

where 

f 

3 

-2.87114 

X 

S 

(6.00558, 

2.01001, 

6.00437, 

2.00881) , 

where 

f 

= 

-2.42173 

X 

= 

(6.99164, 

3.59558, 

6.99066, 

3.59460) , 

where 

f 

3 

-2.42734 

X 

3 

(7.98678, 

1.01224, 

7.98644, 

1.01190) , 

where 

f 

3 

-1.67655 

X 

3 

(7.99948, 

7.99945, 

7.99946, 

7.99944) , 

where 

f 

S 

-5.17565 

q> 

1 

h)  ,  i )  : 

as  in  problea  18. 

Problea  21 

Penalized  three-di aensi onal  Hartaan  function,  N  ■  3 
a)  function: 

M  N 

f  (x  >  =  -  ^  c  exp  [  -  N  a  (x  -  p  .)  ] 

i=l  1  j=l  1J  J  1J 


where 


b)  parameter  values:  M  =  4 


3  10 

30  1 

0.  1  10 

35  1 

1 

3  10 

30  1 

0.  1  10 

35  1 

0.3689 

0.1170 

0.2673 

0.4699 

0.4387 

0.7470 

0. 1091 

0.8732 

0.5547 

0.03815 

0.5743 

0.8828 

c)  dimension:  N  *  3 

d)  region:  D  *  {  0  4  x.  4  1,  j  »  1,...,N  ) 

e)  penalization: 

N 

w(x)  *  u(x  .-  0.5,0.5,100,2) 


f)  ainiaa  in  the  region  D  :  a  global  aininua  at 

x  =*  (0. 11461,  0.55565,  0.85255),  where  f  »  -3.86278 
and  two  other  local  einiea  at 
x  =  (0.10934,  0.86052,  0.56412),  where  f  =  -3.08976 
x  *  (0.36872,  0.11756,  0.26757),  where  f  =  -1.00082 

g)  initial  point:  x^ .  *  0.5,  j  =  l,...,N 

h)  source:  Appendix  1  in  ref.  C33 
l)  notes:  none. 
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Problem  22 

Penalised  si x -d i mensi onal  Hartman  function,  N  =  6 

a)  function:  as  in  problem  21 

b)  parameter  values:  M  =  4 


1  10 

3  17  3.5 

1.7 

a  i 

i 

1 

1  .05 

10  17  .1 

a 

14  1 

II 

r— * 

ra 

bJ 

II 

<r 

1 

i  j  13 

3.5  1.7  10 

17 

8  1 

l 

!  17 

8  -.05  10 

0.  1 

14  1 

1  0.1312 

1 

0. 1696  0.5569 

0.0124 

0.8293 

0.5886 

1  0.2329 

0.4135  0.B307 

0.3736 

0. 1004 

0.9991 

P  =  [  p  ]  *  1 

ij  1  0.2348 

0.1451  0.3522 

0.2883 

0. 3047 

0.6650 

1  0.4047 

0.8828  0.8732 

0.5743 

0. 1091 

0.0381 

c)  dimension:  N  ■  6 

d)  region:  D  =  {  0  6  x  . 

-  1 »  j  s  1  >  •  • 

.  ,N  > 

e)  penalization: 

N 

w(x)  =  ^  u(x  -  0.5,0.5,100,2) 


f)  minima  in  the  region  D  :  a  global  minimum  at 

x  =  (0.20169,  0.15001,  0.47687,  0.27533,  0.31165,  0.65730) 
where  f  =  -3.32237,  and  another  local  minimum  at 
x  =  (0.40465,  0.88244,  0.84610,  0.57399,  0.13893,  0.038496) 
where  f  =  -3.20316 

g)  initial  point:  ^  .  -  0.5,  j  =  i,...,N 

h)  source:  Appendix  1  in  ref.  C31 

i )  notes:  none. 


Problem  23 

Penalized  levy-Montal vo  function,  type  1,  N  *  2 


a)  functions 


f(x)  =  (n/N)  {  10  sin~(ny  )  <y  -  1)“  + 

1  N 


N-l 


where 


■vr — 1  2  2 

+  s*  (y  -  1)  El  +  10  sin  (»y  )] 

“  J  j  +  1 

j  =  1  , .  .  .  ,N 


J  =  t 


y  .  =  1  +  (x  1 ) / 4 , 
J  J  ' 


b)  parameter  values:  none 

c)  dimension:  N  =  2 

d)  region:  D  -  (  -10  i  i  10,  j  =  1,...,N  } 

e)  penalization: 

N 

m(x)  =  u  ( x  ,10,100,4) 


f)  minima  in  the  region  D  :  a  single  global  minimum  at 

x  .  *  1,  j  *  1,...,N  ,  where  f  =  0 

and  a  number  of  local  minima  of  the  order  of  5 

g)  initial  point:  xqj  =0,  j  =  1,...,N 

h)  source:  ref.  C53 

i)  notes:  three-dimensional  plots  of  f  are  given  in.  C  5  3 


Problem  24 

Penalized  levv-Mont al vo  function,  type  1,  N  =  3 

a),  b)  :  as  in  problem  23 

c)  dimension:  N  =  3 

d) ,  e),  f  > ,  q),  h),  i)  :  as  in  problem  23. 


Problem  25 

Penalized  Levy-Montal vo  function,  type  1,  N  =  4 

a) ,  b)  :  as  in  problem  23 
c)  dimension:  N  =  4 

d>,  e) ,  f>,  g),  h),  i)  :  as  m  problem  23. 


Problem  26. 

Penalized  Levy-Montal vo  function,  type  2,  N  =  5 

a)  function:  as  in  problem  23,  but  Mith 

y.  *  x.  ,  i  -  i,.  •  •  ,M 

b)  :  as  in  problem  23 

c)  dimension:  N  ■  5 

d)  ,  e)  :  as  in  problem  23 
f>  minima  in  the  region  D  : 

a  single  global  minimum  as  in  problem  23, 
and  a  number  of  local  minima  of  the  order  of  10 
g),  h),  i)  :  as  in  problem  23. 


Problem  27 

Penalized  Levv-Montal vo  function,  type  2,  N  =  8 

a) ,  b)  :  as  in  probl em  26 

c)  dimension:  N  =  3 

d)  ,  e) ,  f),  g),  h),  i)  :  as  in  problem  26. 
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Problea  28 

Penalized  Levy -Montalvo  function,  type  2,  N  =  10 

a > ,  b )  :  as  in  problea  26 

c)  diaension:  N  *  10 

d)  ,  e) ,  f),  g),  h),  l)  :  as  in  problea  26. 


Problea  29 

Penalized  Levy-Montal vo  function,  type  3,  range  10,  M  =  2 


a) 

f uncti on: 

f  (x)  * 

0.1 

(  sin^(3x 

V 

*  <XN  ' 

L)  ^  Cl  *■  sin^  (2x  x^)  1  +■ 

N-l 

♦  T" 

2  2 

(x  -1)  E 1  +  si n  (3x  x  )1 

i  i  +  1 

i  *1 

• 

b) 

parameter 

values:  none 

c) 

diaension: 

N 

*  2 

d) 

,  e)  :  as 

in  problea  23 

f ) 

ainiaa  in 

the 

region  D 

:  a  single  global  ainiaua  at 

xi  *  l’ 

j 

=*  1 , . .  .  ,N 

,  ahere  f  =  0 

and  a  nuaber 

of  non-global  minima  of  the  order  of  30 

<3> 

,  h )  ,  i  )  : 

as 

in  prob 1 . 

23. 

Problea  30 

Penalized  Levy-Mont al vo  function,  type  3,  range  10,  N  =  3 

a ) ,  b )  :  as  in  problea  2° 
c  )  d  i  .iiens  i  on  :  N  =  3 

d/,  si,  f?,  g>,  hi,  li  :  as  in  problem  29. 


Problea  31 

Penalized  Levy- Montalvo  function,  type  3,  range  10,  N 

a) ,  b)  :  as  in  problea  29 

c)  diaension:  N  =  4 

d>,  e) ,  f),  g),  h),  i)  :  as  in  problea  29. 


Problea  32 

Penalized  Levy-Montalvo  function,  type  3,  range  5,  N 

a) ,  b )  :  as  i n  prob l ea  29 

c)  diaension:  N  *  5 

d)  region: 

d)  region:  D  *  C  -5  i  x.  &  5,  i  *  > 

e)  penalization: 

H 

a  ( x )  a  ^  u(x  ,5,100,4) 
i*l  1 

f)  aimaa  in  the  region  0  : 

a  single  global  ainiaua  as  in  problea  29, 

and  a  nuaber  of  local  aimaa  of  the  order  of  15 

g) ,  h),  i)  :  as  in  problea  29. 


problea  33 

°enalized  Lew -Mon tal vo  function,  tvpe  3,  range  5,  N 

a  1  .  3  !  :  is  in  or  oo 1  era  32 
: .  3  l  o  e  n  s  l  o  n  :  N  =  o 

3  .  ■?  ■■  .  -  .  3’.  o',  i  ;  :  as  in  orobiem  32. 


Problem  34 

Penalized  Levy-Montalvo  function,  type  3,  range  5,  N  =  7 


a),  b)  :  as  in  problem  32 

c)  dimension:  N  =  7 

d) ,  e) ,  f),  g),  h),  i)  :  as  in  problem  32. 


Problem  35 


A 

f uncti on  wi th  a 

cusp-s 

haped 

mini  mum 

a) 

f uncti on : 

f  ( x  )  = 

5 

(  t; 

2 

j  x 

1/4 

) 

j=i 

J 

b) 

par ameter 

values:  none 

c) 

di mensi on 

:  H  = 

5 

d  > 

region: 

D  =  ( 

-20000 

L 

x  . 

j 

6  10000, 

j  =  1 , .  .  .  ,  N  ) 

e) 

penal ization: 

none 

f  ) 

minima  in 

the  region 

D 

s 

• 

a  single 

global  minimum  at 

o 

M 

X 

J  = 

l,... 

.N 

1 

where  f 

=  0 

initial  point: 

v  s 

"  3  J 

1000, 

J  =  1 , 

.  .  .  ,N 

h)  source:  suggested  bv  one  of  the  authors  (V. P.) 
l)  notps:  non -d i f f er en t l ab 1 e  problem:  the  only  (global)  mini 
mizer  is  a  singular  point  with  unbounded  derivati 
■/e;  the  eigenvalues  of  the  hessian  matrix  are  s 
vervwhere  of  mixed  sign. 
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Prodleo  36 

A  function  «ith  *  global  ainiaua  having  •  snail  region  of  at¬ 
traction,  a  •  10,  N  ■  2 

a)  function! 

f (x)  ■  I x  H 2  -  (C  ♦  hi  gix) 

wharf 

g  < k )  ■  axp  {  -  3  /  (  b2  -  S  >  >  <  S  <  b2) 

■  0  (  S  k  b“! 

s  -  a*  -  c»2,  c  ■  id2 

and 

*  *  (Xj  ,  x j  «•••*  *N  C  •  (a,  0,  0,...,  0) 

b)  paraactar  valuatt  a  ■  100,  b  ■  1,  h  •  10 

c)  dlaenaiont  N  ■  2 

d)  ragiom 

D  •  (  -1000  a  Xj  a  1000,  J  ■  > 

a)  penalization:  nona 

f)  aimaa  in  tha  ragion  D  :  a  aingla  global  Bininua  at 

x  •  (99.99001,  0),  *har#  f  ■  -10.99663 
and  another  local  ainiaua  at 
x  ■  (0 |  0) ,  Khar#  f  •  0 

g)  initial  point:  x  ^  ■  (0,  100) 

h)  aourcai  auggeated  by  ona  of  tha  author*  (F.A.P.) 

1)  notai:  tha  perturbation  to  #  x  M  ,  which  contains  tha  glo¬ 
bal  'tnniir.ua,  is  "visible"  only  in  a  **all  naigh- 
b o r h o o d  of  the  point  c  . 


Problem  37 

A  function  with  a  global  iinimui  having  a  tmall  region  o4 
traction,  a  ■  100,  N  ■  3 


a)  function!  at  in  problem  36 

b)  parameter  valutu  a  ■  10,  b  ■  1,  h  ■  10 

c )  di eenai on i  N  ■  3 

d>  region!  D  ■  (  -100  a  *  100,  j  •  > 

•)  penalization!  none 

4)  minima  in  the  region  0  :  a  tingle  global  minimum  at 
x  ■  (9.91061,  0,  0,  0,  0),  wntrt  f  ■  -10.89732 
and  another  local  minimum  at 
*  ■  (0,  0,  0,  0,  0),  where  4  ■  0 

g)  initial  point!  xq  ■  (0,  0,  0,  0,  10) 
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FORTRAN  listing 


j 


I 


N  =  5 

wu  ^  1300. oa 
JNIN  -  -ZjOOO.dO 
VHAX  -  1 30  Ou . D  0 
Go  10  «C0 

36  A  FUNCTION  WITH  A  SH  A  i_L -A  I T  UA  C  T  1  ON- BEG  I  ON  GLOBAL  BINIBUN  (N 

363  CONTINUE 
>i  =  i 

X.I1)  =  O.DO 
JCTZ)  =  100. DO 
WHIN  *  -1000. DO 

J  A A  A  =  IOuC.DC 

GO  10  ’ud 

3?  a  function  with  a  snalL-aTTKaction-begiON  Globa<-  nInJhu"  tN 
i ?o  continue 

N  -  5 

JUT  1 ,  =  0.00 
JOT,;)  =  O.Dg 
JOTJ)  =  0.00 

xau)  =  o.do 

XUTiJ  =  TO-oO 
VHIN  =  -TOO. DO 
VHAA  =  100. DO 

GO  10  700 

7.0  CONTINUE 

DO  71 J  I  =  1  ,N 

XN1NTI)  -  VN1N 
aNAXCI)  -  VIA* 

7n  CONIINUE 
RE  TURN 

633  CONTINUE 

DO  h  1  J  1  =  1 ,N 

AN  1 N ( I )  i  V-IN 
X^AJIl)  -  VNAX 
1  0  CONIINUl. 

,-3  CONTINUE 

JO  / 1  3  I  —  1  *  N 

X'3  (  I  )  =  VO 

;  1  3  CONIINUL 
R  L  T  OH  N 


GlI P2B40 
6LTP?B7q 
6lI P2880 
GLlp2890 
GlI pZ900 
G  l I PZ  91 0 
2)GlIPZ920 

GLIPZ930 
GLIPZ9A0 
G  L I PZ  95  o 
GLI PZ960 
6L1PZV70 
GlI p2980 
Gl) pZ990 
G  L I P  3  000 
GlI P30T0 
516LIP3020 
&LjP3030 
Gl1P30*U 
GLI P3Q50 
6L1P3060 
GlIP3q7q 
GLI P308  0 
6lIp309q 
GlTp3 1 Oq 
6lI>3110 
G  o I p3 1 2D 
SlIp3130 
GLIP3140 
GLIP3150 
GLI p316q 
6LIP3170 

G  Li P3 1 8  q 
StlP3190 
6LIP3Z00 
6LIP3Z10 
6LIP3Z2Q 
GLI P3Z30 
6LIP3ZG0 
GLIP3Z50 
6LIP3Z60 

Gl1p327o 

GLIP3280 
GLIP3Z90 
GLIP3300 
&LIP331C 
GlIp332q 
Gl  I P  3330 
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so  JO  3  1  S 
C 

C  ’3  PENALIZED  LE  VY-NOINTAL  «0  FuNtTION,  TYPE  ^  (N  =  1C) 

C 

3 i "!  CONTINUE 
1  B  10 
SO  10  115 
C 

C  39  PENALIZED  LEVY— NONTAL  VO  FuNCT10N,  TYPE  j,  PAUSE  *  10  (N  =>  3) 
C 

291  CONI I  HUE 
N  =  3 
SO  10  115 
C 

c  TC  PENALIZED  LEVY-NONTaL aO  FuNjTlON,  type  3,  DArSE  *  to  <U  *  3) 

( 

:u3  CONTINUE 
N  ,  3 

SO  10  315 

c 

C  31  PENALIZED  LEVV-MONTAL VO  FUNCTION.  TYPE  3,  DANSE  *10  <N  »  *> 

C 

310  CONTINUE 
I  .  i 
c 

315  CONTINUE 
VO  >  O.DO 
VNIh  *  -10. DO 
VN  AX  *  10.00 
SO  10  3C0 
C 

C  32  PENALIZED  LEVY— MONTALVO  FUN(TION.  TYPE  3.  DArSE  *  5  (N  *  5> 

C 

320  CONTINUE 
N  ,  5 
SO  TO  3S3 


C 

C  33  PENALIZED  LEVY-NONTAL <0  FUNCTION.  TYPE  3.  DANSE  *  5  (N  x  6) 
C 

3 30  CONTINUE 
N  =  6 
60  TO  3*5 
C 

C  3*  PENALIZED  LcVY-NOnTAL »0  F  uN  CT I ON ,  TYPE  3 .  DArSE  *  5  <N  *  7) 

L 

3*"  CONTINUE 

N  -  1 

C 

3*  r  CONTINUE 
Vs  -  *  *i  J 

V«IN  =  -‘.00 

VN  *X  -  3  .  D  " 

s*.  ro  .3 

t 

c  *:  »  function  .iim  *  ip.l.  j° -Cmapt  g  .nin:«,u«,  (*  =  )) 


’  ,  ’  Cv-NFIN'JE 


6LIP3290 
SLIPZ300 
6LIPZ310 
6LIP2J3Q 
Scl P2330 
6LI P3  3*0 
SLIPZ350 
SLIPZ360 
6LIPZ370 
6LI P? j3  0 
SLIP3390 
GLIPZLoO 

6L1P3L10 
SLIP3LZ0 
SlI PZ*30 
sLiPZ4*C 
SlI P3C50 
6LIP3C60 
SL1P2S70 
SLI P3S80 
SLIP3490 
6LIP25OO 
6LIP3510 
SLIP3530 
SLIP3530 
SLI P2  3*0 
SLIP3550 
GLIPZS60 
SLIP3570 
GLIP2S80 
GL1P2590 
6LIP2600 
6L]P3610 
SLI PZ620 
GLIPZ630 
SLI P26*0 
6LIP2650 
SLI P2660 
6LIP2670 
GLIPZ6S0 
GlIP269q 
6LIPZ700 
SLI P2  71 0 
SLIPZ7Z0 
6LjPZ730 
SLIPZ740 
GLIPZ750 
GLI PZ  74  0 
SLI PZ  770 
SLIP3730 
SL1P3790 
GLI PZ  833 
SLIPZ310 
5LIP33ZG 
3LIP333; 
SLIPcJAC 
GlIP2S50 
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C  19  PLNALlZtD  SHEKEL.  FUNCTION,  N  =  7  (N  =  *) 

C 

ISO  CONTINUE 
C 

C  ?3  PENALIZED  SHEKEL  FUNCTION,  N  =  TO  (N  =  * ) 

c 

2C0  CONTINUE 

Nr* 

VC  r  9. DO 

V*IN  *  3. DO 
VNA*  =  10. DO 

GO  TO  830 
C 

C  21  PENALIZED  THREE-01NEN 3I0NAL  HaRTNaN  fUNCTjO^  (N  *  3> 
C 

210  CONTINUE 

N  =  1 
GO  TO  225 
C 

C  22  PENALIZED  SIX— OINENSI ONAL  HARTNAN  FUNCTION  (M  »  6> 

c 

220  continue 

N  =  6 

225  CONTINUE 

VO  =  0.5RO 
VHIN  =  C.OO 
VN AX  *  1.D0 
GO  TO  800 
C 

C  23  PENALIZED  LEVT-NONTALvO  FUNCTION,  TTPe  T  C-  =  2) 

c 

230  CONTINUE 
N  r  2 
GO  TO  315 
C 

C  2*  PENALIZED  LEVT-NONTAL VO  FUNCTION,  TTPE  j  EN  *  3> 

2*0  CONTINUE 

N  =■  J 

GO  TO  315 
C 

C  25  PENALIZED  LEVT-NONTALVO  FUN  CT10N ,  TTPE  1  C*  *  *> 

c 

25-  CONTINUE 

Nr* 

so  n  ns 
c 

:  2c  PENALIZED  LEVT-NONTALVO  FUNCTION,  TTPE  t  <N  =  5) 

c 

2-2  CONTINUE 

‘I  =  ' 

Gw  io  :  1  ‘ 

w 

C  2;  ".NALi.’iD  IlVT-NONTaL <0  F^N^TION,  TTP£  2  I*  =  8) 

.  i  ' 


GLIP1720 

GLIP1730 

6  LI  PI  7*0 

SLIP1750 

6LIP1760 

6L  j PT  770 

GLIPl 780 

GLI Pi  790 

GlI Pi  800 

GLIP1810 

GlI  PI  820 

GLIPT830 

GLIPT 8*0 

GLIPl 850 

6LIP18&0 

GLI Pi  870 

GLIPl 880 

GLIPl 890 

GLIPl 900 

SLIPT9T0 

GLIPl 9?0 

GLIPl 930 

6LIP19*0 

GLIPl 950 

GLI Pi 96fl 

GLIP197Q 

GLIPl 98q 

GLIPl 99  g 

GLIP200Q 

GLIP2010 

6LiP2020 

GLIP2030 

CLIPZOIO 

GLI P2Q50 

GLIP20A0 

GLIP2070 

SLIP20S0 

GLIP2090 

GLI P2 100 

GLIP211 0 

GLIP2120 

GLIP2130 

6L,P21*0 

GLIP2150 

GLIP2160 

SLIP2170 

6LIP218Q 

GLIP2190 

GLIP2200 

GLI P221 0 

GLIP2220 

GLIP2210 

GLIP22*Q 

GL1P225Q 

6LjP2260 

GLIP22Z0 

SLI P22*3 
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c  »  faction  «iih  thre:  ill-c *ndiii3ned  "inira,  a  =  io  <n  =  2> 

c 

1 CONTINUE 

c 

C  11  A  FJNtHCN  «tTH  THREE  I  LL  _C  CNO  I  T I  OM  ED  MN1NA.  A=1C**2  (N  *  2) 
C 

II'1  CONTINUE 

c  u  4  function  »ith  three  ul -conditioned  ninina,  a=io**3  (n  *  2) 

c 

1J  CONI  1 .1 U E 

C  13  A  FUNCTION  WITH  THREE  IeL-COMDITI  OM  ED  NININA,  A=1D»*A  <  •»  *  2» 

C 

13  3  C0N  1 1 HUE 

c  n  •  function  «ith  three  ill-conditioned  NININA,  A=10»«5  (M  =  2) 

c 

143  CONTINUE 

C  15  A  FUNCTION  WITH  THREE  Ul _ C  OMO I T I OM  ED  NININA,  A=10*»6  <*  *  2> 

C 

153  CONTINUE 

1  =  2 

iOd,  =  a. oa 

*0(2)  =  O.Og 
IRU(I)  *  -10. „J 
X  H AX (  1  )  -  10.00 

*hi*(2)  *  -no.so 

X  N  X  X ( 2  )  =  100.90 
RETURN 
C 

C  1o  G0L3STEIN-PRICE  FUNCTION  (N  *  2) 

C 

1 6  C  CONTINUE 
1  =  2 
VO  =  1.00 
tf N ! N  =  “2.00 
VN  AX  =  E.03 
GO  TO  ®oa 
c 

C  17  »ENAL17E9  3RANIN  FUNCTION  IN  *  2) 

C 

17"  CONTINUE 
N  - 

«  j  (  1  ,  =  2  .  "  0  3 

<3(c)  -  7. 3  5« 

t  H  I  ft  (  1  )  -  -  2 . 0  2 

f NAX (  1)  -  1  5. o'1 
X  N  I  N  (  .  )  =  •  D 

x  «  A  X  (  .  )  -  15.00 

RETURN 

:  ’  Rf  'HU.’tJ  CHtxF,.  HJNCIIuN,  .1=3  (  N  =  <.  ) 

C 

1  '  C  .  *  I  ’  i '  \ 


GEIP1150 
SLIPl 1 60 
6LI Pi  170 
GeIPUSO 
GLIP1 190 
6LI Pi  230 
GLI Pi  21 0 
6L1P12Z0 
GLI Pi  230 
6LIP1 2A0 
GLI Pi  250 
GLI Pi  260 
GLI Pi  270 
GLIP1250 
SLI Pi  290 
GLI Pi  330 
SLIPl 31 0 
SLIPl 320 
GLIPl 330 
GLIP13A0 
6LIP1350 
GLI P^ 360 
GLI Pi  370 
6LIP1 380 
GLIPl 390 
GLIPt Ago 
GLI PI  A 1 0 
6LIP1A20 
GLlp1A30 
GlIrIAAO 
GLlp1A50 
GLIPTA60 
GLIPl AFO 
6L I  Pi A80 
GLIPl A90 
GLIPl 530 
6L1P1510 
GLIPl 520 
GLIP1530 
GLIPl 5 AO 
SLIP1550 
6LIP136U 
6L i Pi  570 
GLIPl 580 
SLI Pi  590 
GLI Pi  630 
GLIP1610 
GLIP1620 
SlIPI 630 
GlI pi 6AQ 
Gl I  pi  65  0 
Gclpl 660 
SL I  Pi  673 
SLIP16»0 
*;L  |  Pi  693 
GlI Pi  730 
3  L I  P 1  71  3 
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1 


13  CGNIINUE 

SLIP05S0 

N  =  1 

SLIP0S90 

V  j  -  J.&O 

GLIP0600 

,N 

vilN  =  -lu.aO 

SLIP0610 

VHAX  -  10. DO 

6LIP0620 

GOTO  ICG 

BLIP0630 

P 

c 

GLIP064Q 

c 

4  *  FOURTH  OROER 

POLTNONI *L 

IN  THO 

VARtABLES 

<N  “ 

2) 

ELIP0650 

c 

gLjP0660 

40  CONTINUE 

SLIP0670 

N  -  ? 

ELIP0680 

*a<i>  =  i.do 

ELIP069Q 

XGT2)  =  O.Oq 

ELIP0700 

VAIN  -  -10. 0D 

6LIP0710 

1 

VHAx  3  10. 00 

SLIP0720 

GO  TO  TCG 

ELlp0730 

-J 

c 

ELIP0740 

c 

5  4  FUNCTION  ■ I TH 

A  SlNaLk 

ROa  OF  LOCAL  NlNlaA 

<N 

3  2) 

ELIP0750 

c 

EL1P0760 

50  CONTINUE 

BLIP0770 

p  * 

N  =  2 

SLIP0780 

yj 

X0<1>  =  -5.00 

ELIP0790 

XD  <  2 )  =  0.03 

BLIP0800 

: — v 

xnin(i>  =  -15. oO 

ELIP0810 

XHAX(I)  -  25.00 

ELIP0820 

XNI N  T  2 )  *  -5.00 

fiLlpOSSO 

•* 

XNAX(2>  3  15.00 

ELlp0840 

RETURN 

El I pO 850 

1 

c 

EL1P0860 

c 

6  SIX-HUNP  CANEL 

FUNCTION 

** 

f\J 

It 

w. 

w 

BLIP0870 

ft 

c 

Gi 1PO88O 

DO  CONTINUE 

ELIP0890 

.*  J1 

N  -  2 

ELIP0900 

VO  s  3. 00 

EHP0910 

(NINTH  =  -3.00 

SLIP0920 

IRAKI)  3  3. DO 

ELIP0930 

XHINT2)  *  -2.00 

ELIP09A0 

XNA A  C2 )  3  2.00 

Eli p0950 

m 

GO  TO  900 

SlIp09A0 

c 

SLIP0970 

•  'j 

c 

7  TWO-OINENSIONAL 

PENALIZED 

snuaeRT 

F  UN  CT  lON  » 

BETA 

3  0  (N  3 

21 

ELIP0980 

w 

c 

SLIP0990 

r.  . 

n  CONTINUE 

6LIP10DQ 

•’  .  % 

c 

SUP1Q10 

c 

•  T.0-9JNENSI0NAL 

PENALIZED 

S HUBERT 

F  UNCTION, 

beta 

3  1/2  TN 

*  2) 

ELIP1020 

c 

ELI P1030 

• 

} ?  CONTINUE 

ELI  Pi  040 

c 

SLlPlOiO 

- 

*•  .1 

c 

,  T.O-OINENSIUNAL 

PENAL.ZtO 

shubert 

FUNCTION, 

BETA 

=  1  IN  = 

2) 

BLIP1060 

•vj 

(. 

SLIP1070 

>'•  CONTINUE 

SLlPl 080 

*,  i 

,  _ 

eli piC90 

■/ ..  j  .  u  r 

SLIPl 1 30 

=  -'Z.iC 

SLIPIUO 

• 

--  1".3J 

GLIP1120 

-R 

„  it  "  r 

GLI P1 1 30 

SLIPIUO 

.  % 


*JX. 
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c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 


c 

c 


c 

c 

c 


10 


c 

c 

c 


SUBROUTINE  uLONIP  (NPROB,  N,  AC,  XMIN,  XNAX) 

iNE  Subroutine  glonip  provides  the  coding  top  the  number 

Of  VARIABLES,  The  INITIAL  POINT,  AND  THE  OBSERVATION  RE6I0N 
TC  JE  USED,  TOG  i.  r  HE  R  •  I  IH  TmE  37  TEST  FUNCTIONS  GIVEN  eY 

subroutine  glontf  ,  ro  otf.Nt  3?  test  problems  for  global 

TlK/ilATlO,  S0FTuAa£. 


the  subroutine  glonip  Returns  in  n  ,  xo  ,  and  xnin  , 

XNAX  THE  NUMBER  OF  VARIABLES,  THE  INITIAL  POINT,  AND  THE 
BOUNDARIES  of  the  observation  region. 


CALLING  STATNENT 

CALL  GLONIP  CNPR08,  N,  Xu,  XNIN,  XNAX) 

DESCRIPTION  Of  THE  CALL  PARAMETERS 

(The  FORTRAN  IMPLICIT  TYPE  DEFINITION  FOR  INTE6ERS  is  used. 
*ll  non-integer  parameters  are  double-precision). 

NPRCP  IS  THE  (INPUT)  bUMgtR  Of  THE  TEST  PROBlE*  To  BE 
CONSIDERED 

N  IS  The  (OUTPUT)  NUMBER  OF  VARIABLES  (DIMENSION)  OF 

the  problem 

XMIN  ,  XMAX  ARE  THE  (uUTPUT)  N-VECTORS  CONTAINING  THE  LEFT 
AND  RIGHT  BOUNDARIES  OF  THE  OBSERVATION  REGION 

define,,  a*  The  points  x  *  (xi,...,xn>  such  that 

XNINCI)  .LE .  HI)  .LE.  XNAXCI),  I  *  1.....N 

DOUBLE  PRECISION  XO.XNIN.RRAX 
DOUbLE  PRECISION  VO.VNIM.VMAX 

D1*ENSI0M  XQ (1 )  ,XMIN(1 )  ,XHAX ( 1) 

GO  10  (10  20,30,40, 50, 6u, 70, 80. 90, 100, lto.120. 130,1*0,150, 

1  1 60. 1 7j, 1 80, 19o, 200, il 0.720, 23 0.2*0, 250, 260, 270, 280, 

2  290, 300, 310, 320, 330, 3*0. 350, 360, 370). NPROB 


1  A  FOURTH-ORDER  POLYNOMIAL  IN  »  1) 

CONTINUE 
N  =  1 

VO  =  1.000 
VM1N  =■  -10. 00 
VMAX  =  10. DO 
GO  10  300 

C  GOLOSTEIN  SIXTH  ORDER  POLYNOMIAL  CM  =  1) 

CONTINUE 
i  -  1 
VU  r  J.oO 
/MIN  -  — *  •  0  0 
VMAX  -  * • DC 
G  J  TO  i  CQ 

IN' -0  I 'ENS IONAI  pfcNAL  « I  c.  0  ShUbf*t  fUMCTjON  (n  =  1) 


GLIP0010 
SlIP0020 
GlIPOOSO 
GLIPOOAO 
6LIP00S0 
GLIPCOftO 
GLIP0070 
GLIP0080 
GL1P0090 
SL  jPOl DO 
GLIP0110 
GLIP0120 
GLIP0130 
G  L I P01 *0 
GLIP0150 
5LIP0160 
GLIP0170 
GLIPgidO 
6LIP0190 
GLIPC200 
6LIP0210 
6LIP0220 
GL1P0230 
6LIP024Q 
GL1P0250 
GL1P0260 
SLlp0270 
GLIP0280 
GLIP0290 
6LIP0300 
GLIP0310 
S  LI P0320 
GLIPO33O 
GLIP03A0 
GLIPq35q 
GLIP0360 
GLIP0370 
GLIP0380 
GLlpOS’O 
6LIP0*00 
6LIP06IO 
GLIP0420 
GL I Pg*  3g 
GLIP0**0 
GLI pO*5g 
SLIP0460 
GLIP0470 
SH  P0480 
GLIP0490 
6LIP0500 
6LIP0510 
GLIP0520 
SL1P0530 
SL1P0540 
GlI PC550 
GLIPC560 
slIP0570 


Do  o  i  -  1** 

» { ; )  -  mi 

2  v  *  C  o  N  I  I  N  0  c. 

c 

c  .  G  C  w  '.  II  N  U  c 

I.SJ  -  IC.rjtbS.N  IP1»T  <  l)  J»*2  ♦CY<„>  -1  ,dC>*»2 
_  7  *  —  o  .  f, 

F  U.tZ  =  fuNZ*CY<I-1)-1.l(QJ»«2*C1.GC»1G.O0»OslN<PJ*t(,))**2) 

Jo’  CwN  l  I.nUl 

fuNZ  -  IU.N/*P1/I>3LE  CFlOaTCNI) 

JANoE  -  IL.oO 
GC  10  7*7 
c 

c  :r  ihnalizod  le vy-nontal  ,o  Function,  type  3,  r ange  =  ig  cn  =  ?) 

c 

0,0  CONTINUE 

c 

C  ’0  PENALIZED  LEVY-NONTAL  vO  FuN^TION,  TYPl  At  »ANuE  =  10  CN  *  3) 

E 

3oO  Continue 

c 

C  51  PENALIZED  LE V Y -NON T AL WO  FUNCTION.  TYPE  3,  RANGE  =10  CM  *  *> 

C 

510  CONTINUE 

RANG!  =  lu.DO 
GO  10  3*2 
C 

C  PENALIZED  LEVY— NONTAL  vO  FUNCTION,  TYPE  3,  RANGE  =  5  CN  =  5> 

c 

J  •.  ",  C  0  N  T  I  N  U  t 
o 

C  ’1  PENALIZED  LLVY-NONTAL yO  FUNCTION,  TYPE  3,  RANbE  =5  (N  =  6) 

C 

j;n  continue 

c 

C  I A  PENALIZED  LE VY-NONTAL VO  FUNCTION,  TYPE  1,  RANbE  =  «,  (N  =  7) 

C 

3*2  CONTINUE 

MANGE  -  '.DO 
Continue 

»0NZ  =  USlNC?.Dt)*PI*XC1  ))*•, 

1  ♦<XCN>-1.DU>»*2»<1.Do*USANl2.00»PI*XCN>)**2) 

DO  5  *  ^  I  =  o  t  N 

1  iJ Z  r  r  one  ,  <*  l  I-I  )- I.GC  j  •  (1  .DC  *001  N(3.Do»Pl  *x  (I  )  )«*2) 

3*'  Co..Il,-,m 

lyiz  -  i unz • too 

1,7  C  ON  UNIIL 

Do  _■•/  i  =  1  i  1 

:  I  (  o  Ao  S  (  X  (  I  )  )  .GI  .RA.tGl  ) 

1  *o«,o  -  i  U..Z  «PLNI  u.,(  A<  i  )  ,RANbf  ,  1  Go.  DC  ,  A  ) 

h  ;  CoNIINUl 

R  *  1  o  ,  it 

c 

C  :  A  foNLUCN  .IIH  X  5UoLi  LUNP-GHAPrD  NiIMnUn  (n  =  j) 

c 

roM :  .iu 

I  oi  .  -  0.0 


GLT  f  1*30 
GlT  F  3  4*0 
GlTF?*50 
GlTF  3*60 
GLT  F3A70 
GLTF 3A30 
GlTF 3*90 
GLTF3500 
G  lT  F  3  5 1 0 
GlT  F  3520 
GLTF3530 
GLTF  35*0 
GLTF3550 
GLTF3560 
GlTF357q 
GlTF353U 
GltF359q 
GLTF  *600 
, olf3610 
GLT F  3 620 
6LTF363G 
G  LT  F36A0 
GlTF  365q 
GLTF3660 
GlTF367q 
GlTF3680 
GlTF  3690 
GLTF  3700 

GlTF37tO 

6LTF372Q 
GLTF3730 
GLTF  37*0 
GLT  f3750 
6LTF3760 
6LTF3770 
GLTF  3  780 
6LT  F  3  79q 
G  L T F  3 800 
GL-jF  3H10 
GltT382j 
SLTf3S3o 
GLTF?8*0 
GLTF3350 
6  LT  F  3  860 
6lTF3870 
6LTF388Q 
GLTF389Q 
ClTF3900 
GlT  F  3  91 0 
G  l  T  F  3  9?C 
G  L  T  F  3  9  5  0 
GltF7?*Q 
GLTF3950 
GlTF396u 
GlTf’ V7o 
GlTF*  ,30 
GLTF  399o 


>■  =  4 

F  jNi  -  o  •  w  C 
Wo  *.1/  I  —  1  ,  Pi 

“  u  •  b  o 

o  0  313  J  -  1  ,  N 

i  -  S-PolA(l,j)*t*Cj)-Po1b(I,J))*»? 

..  1  *  LUI)  I  iNUf 

if  C..UE.PtlGJ  f UN 2  =  fUNZ_Pz1C<I>  *DEXP(S> 

217  C  C ,  I  I N  U  i 
Go  ro  ?e* 

2t  PtNiLJUD  SIX-01NENG1 oNAL  HaRTNAN  fUNCTjON  (N  =  6) 

1 1  ",  CoMlNUt 

■*  =  4 

f  L  A  t  -  _  •  U  O 

Go  o  t  J  1  —  1  v  N 

>  -  o-o3 

w  c  :j  j  -  i ,  n 

S  =  S-P2?»U,i)*(»(J)-Pi7b(l,J>)**2 

2 t 7  to. XT iNUf 

IF  Co.GE.Pt20)  FUNZ  =  FUNZ-P22CtI)*DEXP(S> 
cominUi 
2.7  Cufll  I  NUt 

GO  2. 9  I  =  1,N 

If  (uAuSCXCn-O.SDO)  .6I.U.SD0) 

1  foNi  -  f UNZ«PENF UmCa(I) ~0.5t>0,0 .500, 100. DO, 2) 

21*  CoNUnUi 
W  t  Tui*> 

Tj  PtNAliZcD  Lt V T-NONTAEyO  FUNCTION,  TYPE  1  (N  =  £) 
2o3  CONTINUE 

2c  PENALIZED  LEVY— MONTAEvO  FUNCTION,  TYPE  1  <*  *  3) 

:tc  ccntinue 

r*o  PcNALIZLO  LEVY-NONTALVO  FUNCTION,  TYPE  1  ( N  *  a  ) 

2  '  0  CuN I  I  SUE 

OC  0  r)  i  1  =■  1  ,N 

Y<i>  =  1.0o*O.Z500* < A<i>-1  .DO) 

2:  ‘  C  C  N  T  I  U  t 
li  U  10  3  c  3 

'  t>  PtNALiZtO  It VY-NONTAL »0  FUNCTION,  TYPE  2  (N  =  5) 

CONTINUE 

T  PLNALiZEO  Lt  VY -NON  TaL  *0  FuNoTlON,  TYPE  2  <n  -  O) 

L  / .  c  c s  1 1  ..  u  t 

rL'iALlZEC  LtVT-NONTAl »0  FuNoTlON,  TYPt  2  <H  =  1 C  > 

„  C  _  ■.  ;  1 


GtT F2860 
GLTf 2870 
GLTF  2  8  g  0 
GLTF2890 
GLTf 2900 
Get  F291 0 
GLTf  2920 
GLTF2930 
GLT  F  2  9Ag 
6eTF295Q 
GET  F  2960 
GET  F  2970 
gLT  j  2  980 
GLT  F  2990 
6ETF3QQQ 
GET  F  J  01 Q 
6LTF3020 
SLTF3030 
get  f  3q4q 
GLT  F3  QSO 
6LTF306Q 
GLT  F  3070 
GLTF3080 
get  F3  090 
GLtF31qq 
GLTF3T10 
6lTf3T20 
6LTF3130 
GCTF31A0 
GET  F  3  T  30 
GcTf 3160 
6LTF3170 
GeT  F  3 1 80 
GETF3T9q 
6LTF3200 
GLTF3210 
get  f  3220 
6CTF3230 
6LTF32AQ 
GLTF325Q 
6LTF3260 
6LYF327Q 
GlTF32?0 
6ETf 3290 
GLTF3300 
GLTF3310 
GLTFI320 
GEIF333Q 
GoTF33A0 
6LTF3350 
GETF3360 
GCTf 3370 
G  L 1  F  3  3  8  0 
GLTF339Q 
GLT  F  3400 
GtT  F  3 41 n 
GLTf  ’  4 2 U 


1o  SuLDSTE.N-PRlCE  F  UNC  T  ION  (N  =  2) 

ioO  continue 

U  =  U1  >  ♦*  (  L  )  *1  .DO 
V  =  3. DC** ( 1 ) -I • DO* * ( 2 ) 

Uli  -  U»U 
9V  -  V,W 

f  U  4.  ~  l1*Cw*|jy*(j6»0Q"fcp*Dj*u*5*D0iUU)) 

1  •  f3?.:j*vV*(1?.DG-l6.ou»**3.o0*«V)) 

»£T uRN 

17  PtNALIZ-D  1SANIN  FUNCTION  tN  =  2> 
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lontinoe 

FONZ  r  F-N.  -  1.D0/S 
2-’  C  ';1  UUE 

:  -  - r  *  I  -  1.< 

;f  (oaoSIx ( 1 >-5 .00) . .1.5 .Du) 

1  f0'|4.  ^  fUnZ*PENFUn<*(I)  -5.0  0,5.00,  100. DO, i> 

:  7  CINIINUl 

1  L  7  JF  H 

:  )  th<=  ee  -o i*e n -i onal  hartpan  function  <n  =  j> 

’  '  :/  IIOJ: 


SL  T  F  2290 
6LTF2300 
6LTF231 0 
Sl  T  F  23?0 
6LTF2330 
SLTF23A0 
6LTF2 350 
6LTF 236g 
6L  T  F2  3  70 
6.TF23B0 
6LTF 2390 
6LTF2400 


GLTF  2430 
6 LT F  2  A AO 
6LTF2450 
SltF2*60 
6LTF2A70 
6 L T  F  2  4gQ 
GLTF2A90 
SLTF2500 
6LTF251 0 
6LTF2520 
6LTF2530 
6LTF25A0 
6lTF255q 
6LTF2560 
GLTF2570 
6LTF2580 
6LTF2590 
6LTF26D0 
6LTF  261 n 
GLTF2620 
6LTF2630 
6  LT  F  26A0 
6LTF2650 
6LTF2660 
6LTF267g 
6LTF2680 
6LTf?690 
GLTf 27qo 
GLTF  2  71 0 
GlTF2720 
GLTF273Q 
GLTF  27*0 
GLTF2750 
6LTF276q 
G L TF  2  770 
GLTF  2  780 
GLT  f 2790 
GLTF2800 
GLTF2810 
GLTF2S20 
SLTF2330 
SLTFjSaO 
GLTF 2350 


..2  =  S«.*OI«0t0S((Dl*t.SO)*A<2)*011 
V5  CSNIr^UE 

FUN2  =  FUNZ*S1*S2 

IF  (9APS(X <1 ) ) .ST. 13.D0 J  FUnZ  =  FUNZ*PENFUH(X(1)»10.d0.100.00.2) 
If  £OAGSlX<2)).6T.iO*BO i  fUhZ  *  F  UMZ ♦ PEN  FUN (X(2),1O.DO»10C.O0,2) 
R£  TURN 
C 

C  1j  A  FUNCTION  ■ 1 TH  THREE  I LL “C uNO 1 T I ON  ED  R1HIRA,  A  =  10  (N  *  2) 

C 

1.2  CONTINUE 
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SJCkOJTINL  GLCPTF  (NPR08.  N,  A,  FUNZ) 
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Furious  OF  N  iff  »L  VpRIApLtS,  10  PE  USED,  TOGETHER  WITH  THE 
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ABSTRACT 


3ICMA  is  a  set  of  FORTRAN  subprograms  for  solving  the  global 
optimization  problem,  which  implement  a  method  founded  on  the  numeri¬ 
cal  solution  of  a  Cauchy  problem  for  stochastic  differential  equation.1- 
inspired  by  quantum  physics. 

This  paper  gives  a  detailed  description  of  the  method  as  imple¬ 
mented  in  SICMA,  and  reports  on  the  numerical  tests  which  have  been 
performed  while  the  SIGMA  package  is  described  in  the  accompanying 
Algorithm. 

The  main  conclusions  are  that  SIGMA  performs  very  well  on  sever- 
hard  test  problems;  unfortunately  given  the  state  of  the  mathematic.!1 
software  for  global  optimization  it  has  not  been  possible  to  make  con¬ 
clusive  comparisons  with  other  packages. 


Categories  and  Subject  Descriptors: 

G.i.o  j Numerical  Analysis):  Optimization  -  ; 
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1.  Introduction. 


In  fl]  a  method  for  solving  the  global  optimization  problem  was 
proposed.  The  method  associates  a  stochastic  differential  equation  with 
the  function  whose  global  minimizer  we  are  looking  for. 

The  stochastic  differential  equation  is  a  stochastic  perturbation 
of  a  "steepest  descent"  ordinary  differential  equation  and  is  inspired 
by  quantum  physics.  In  [1]  the  problem  of  the  numerical  integration  of 
the  stochastic  equations  introduced  was  considered  and  a  suitable  "stochas 
tic"  variation  of  the  Euler  method  was  suggested. 

SICMA  is  a  set  of  FORTRAN  subprograms  implementing  the  above 
method. 

In  sect.  2 we  describe  the  method  as  implemented  in  SIGMA;  in  sect. 

.1  we  give  a  general  description  of  the  method  and  some  details  on  the 
implementation;  in  sect.  4  some  numerical  experience  on  test  problems  is 
presented  and  in  sect.  5  conclusions  are  given. 

Unfortunately,  given  the  state  of  the  art  of  mathematical  software 
in  global  optimization,  it  has  not  been  possible  to  make  conclusive  com¬ 
parisons  with  other  packages. 

The  SICMA  package  and  its  usage  are  described  in  the  accompanying 


Algorithm. 


The  method. 


\ 

Let  R  be  the  N-dimensionaL  real  euclidean  space  and  let  f  JR‘  ->-JR 
be  a  real  valued  function,  regular  enough  to  justify  the  following  con¬ 
siderations. 

Ln  this  paper  we  consider  the  problem  of  finding  a  global  minimizer 
of  f,  that  is,  the  point  x  •:  JR"  (or  possible  one  of  the  points)  such 
that 

(d.lj  fix*)  •  f (x )  Vxt  1RN 

and  we  propose  a  method  introduced  in  [1]  inspired  by  quantum  physics  to 
compute  numerically  the  global  minimizers  of  f  by  following  the  paths 
of  a  stochastic  differential  equation. 

The  interest  of  the  global  optimization  problem  both  in  mathematics 
and  in  many  applications  is  well  known  and  will  not  be  discussed  here. 

lie  want  just  to  remark  here  that  the  root-finding  problem  for  the 
system  ^(x)  =  0^,  where  can  be  formulated  as  a  global  optimi¬ 
zation  problem  considering  the  function  F(x)  =  where  !|  •  |j  2 

\  * 

is  the  euclidean  norm  in  R‘  . 

despite  its  importance  and  the  efforts  of  many  researchers  the 
global  opt  imitation  problem  ls  still  rather  open  and  there  is  a  need  for 
methods  with  solid  mathematical  foundation  and  good  numerical  performance. 


* 

The  present  nithors  have  considered  this  idea  both  from  the  mathematical 
point  of  view  .for  .1  review  see  |J|)  and  from  the  point  of  view  of  producing 
good  software  : see  |3|,  |J|).  The  method  implemented  in  [3],  [4|  is  in¬ 
s-urea  in-  classical  mechanics,  uses  ordinary  differential  equations,  and  can 
he  regarded  as  a  method  for  global  optimization. 
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Much  more  satisfactory  is  the  situation  for  the  problem  of  finding 
the  local  minimizers  of  f,  where  a  large  body  of  theoretical  and 
numerical  results  exists;  see  for  instance  [5],  [6]  and  the  references 
given  therein. 

Ordinary  differential  equations  have  been  used  in  the  study  of  the 
local  optimization  problem  or  of  the  root  finding  problem  by  several 
authors;  for  a  review  see  [2]. 

The  above  methods  usually  obtain  the  local  minimizers  or  roots  by 

following  the  trajectories  of  suitable  ordinary  differential  equations. 

However,  since  the  property  (2.1)  of  being  a  global  minimizer  is  a  glo- 

N 

bal  one,  that  is,  depends  on  the  behaviour  of  f  at  each  point  of  ]R  , 
and  the  methods  that  follow  a  trajectory  of  an  ordinarv  differential 
equation  are  local,  that  is,  they  depend  only  on  the  behaviour  of  f 
along  the  trajectory,  there  is  no  hope  of  building  a  completely  satis¬ 
factory  method  for  global  optimization  based  on  ordinary  differential 
equations. 

The  situation  is  different  if  we  consider  a  suitable  stochastic 
perturbation  of  an  ordinary  differential  equation  as  explained  in  the 
following. 

Let  us  first  consider  the  (Ito)  stochastic  differential  equation 
(2.2)  d£  =  -V  f  (£)  dt  +  -.dw 

where  7 f  is  the  gradient  of  f  and  w(t)  is  a  standard  N-d Lmensional 
IV  i  ene  r  p  roce  s  s ,  .  K. 

liquation  (2.2)  ls  known  as  the  Smoluchowski- Kramers  equation  [7]; 
this  equation  is  a  singular  limit  of  the  Langevin's  equation  when  the 
inertial  terms  are  neglected. 


The  Smoluchowski -Kramers  equation  has  been  extensively  used  by 
solid  state  physicists  and  chemists  to  study  physical  phenomena  such 


as  atomic  diffusion  in  crystals  or  chemical  reactions. 


!n  these  applications  (2.2)  represents  diffusion  across  potential 

'IkT 


Harriers  under  the  stochastic  forces  cdw,  where  c  =  / A2AL  ,  T  is 
the  absolute  temperature,  k  the  Boltzmann  constant,  m  a  suitable  mass 
coefficient,  ;ind  f  is  the  potential  energy. 

We  assume  that 


(2.3)  lim  f(x)  =  +  ° 

■  !  X  il  2 

in  such  a  way  that: 

(2.1)  [  e*'4^^  dx  <  »  Vbt  £  (  1R\{ 0 } ) 

IRN 

and  that  the  minimizers  of  f  are  isolated  and  non  degenerate. 

It  is  well  known  that  if  £L(t)  is  the  solution  process  of  (2.2) 
starting  from  ;in  initial  point  x  ,  the  probability  density  function 
p'it.x)  of  ;'  t)  approaches  as  t  -+•  00  the  limit  density  p"(x) 
where 

-  f(x) 

i  2. 3)  pA'x)  =  A.  e 

where  \  is  a  normalization  constant.  ITie  way  in  which  pc'Ct,x)  for 
a  class  of  one -dimensional  systems  approaches  p“ fx)  has  been  studied 
in  detail  bv  considering  the  spectrum  of  the  corresponding  Tokkcr-Planck 


operators  m  IS 


Wo  note  that  n  ;s  independent  of  x  and  that  as  -  ’  0  p_ 
becomes  more  concentrated  at  the  global  minimizers  of  f.  That  is,  I 

ij.nl  I  ;;n  "  i  t  !  =  in  law 

t  -• 

where  has  a  pronaiu  1  i t density  given  by  (2.5)  and  I 

iJ.’l  ’  irn  r7  =  in  law 

n)  : 

where  is  a  random  variable  having  as  its  probability  density  a  I 

weighted  slim  of  Dirac'.-  deltas  concentrated  at  the  global  minimisers  of  f. 

For  example  if  \  =  I  md  f  has  two  global  minimizers  x.  ,  x. ,  with 

--!■  {x-j  =  c.  b,  i  =  1,2,  we  have  (in  distribution  sense)  ! 

J  x  ■  i  i 

(2.8)  1  im  n'!\)  =  .  fx-xj  +  (l-.J  '(x-x-J 

..  a) 

where  •  =  (l + dc . /c  In  order  to  obtain  the  global  minimizers  of  f 

as  asvmptotic  values  as  t  -  ■  of  a  sample  trajectory  of  a  suitable  sys¬ 
tem  of  stochastic  differential  equations  it  seems  natural  to  try’  to  perform 
the  limit  t  -  •  (i.e.  : 2.0) )  and  the  limit  .  -  0  (i.e.  (2.7))  together. 

I  hat  is,  we  want  to  consider: 

‘2.!’)  d"  =  -7f (  ' ]dt  +  . ( t  )du 


-.it h  initial  condition 


o 


In  physical  terns  condition  i2.il)  means  that  the  temperature  T 
is  decreased  to  (>  (absolute  zero)  when  t  *  x>,  that  is,  the  system  is 
"frozen". 

Since  we  want  to  end  up  in  a  global  minimizer  of  f,  that  is,  a 
global  mmimizer  of  the  (potential)  energy,  the  system  has  to  be  frozen 
very  slowly  i udiabat ica  1 1  v) .  file  wav  in  which  -ft)  must  go  to  zero, 
in  order  to  have  that  when  t  -  the  solution  f ft )  of  f2.9)  becomes 
concentrated  at  the  global  minimi zers  of  f,  depends  on  f.  In  par¬ 
ticular,  it  depends  on  the  highest  barrier  in  f  to  be  overcome  to 
reach  the  global  minimizers. 

Hus  dependence  has  been  studied  using  the  adiabatic  perturbation 
theory  in  [1|.  Similar  ideas  in  the  context  of  combinatorial  optimization 
have  been  introduced  by  Kirkpatrick,  (ielatt,  Vecchi  in  [9]. 

In  this  paper  we  restrict  our  attention  to  the  numerical  implemen¬ 
tations  of  the  previous  ideas,  that  is,  the  computation  of  the  global 
minimizers  of  f  by  following  the  paths  defined  by  (2.9),  (2.10),  dis¬ 
regarding  mathematical  problems  such  as  the  difference  between  the  con¬ 
vergence  in  law  of  '(t)  to  a  random  variable  concentrated  at  the  global 
minimizers  of  f,  and  the  convergence  with  probability  one  of  the  paths 
of  "it!  to  the  global  minimizers  of  f. 

We  consider  the  problem  of  how  to  compute  numerically  these  paths 
keeping  in  mind  that  we  are  not  realiv  interested  in  the  paths,  but  only 
in  their  asymptotic  values. 

We  uiscretize  .2.'.'  >.  2.  K'l  using  the  filler  method,  that  is  (MtjJ 

is  approx  muted  by  the  solution  ",  of  the  following  finite  difference 


euu.it  ions  : 


C.15)  'a  =  x2 

k-1 

where  t,  =  U ,  t  =  h- ,  h,  0,  and  w.  =  w(t.  ) ,  k  =  0,1,2,  ...  . 

'  k.  .  i  tc  — k  —  K. 

x=0 

I'he  computationally  cheap  buler  step  seems  a  good  choice  here 
since  in  order  to  obtain  the  global  minimi zers  of  f  as  asymptotic 
values  of  the  paths  ft)  should  go  to  zero  very  slowly  when  t  -  *>, 
and  therefore  a  large  number  of  time  integration  steps  must  be  com¬ 
puted. 

On  the  right  hand  side  of  (2.12)  we  add  the  random  term 
-.(t  )(w^+l  -  k_)  to  the  deterministic  term  -h^  7f(<f^J,  which  is  com¬ 
putationally  more  expensive  (e.g.  N+l  function  evaluations  if  a 
forward -difference  gradient  is  used),  so  that  the  effort  spent  in  evaluat 
ing  vf(f^)  is  frequently  lost. 

In  order  to  avoid  this  inconvenience  we  substitute  the  gradient 
7 f (T )  with  a  "random  gradient"  as  follows.  Let  r  be  an  N-dimensionai 
random  vector  of  length  1  uniformly  distributed  on  the  NI -dimensional  unit 
sphere.  Then  tor  any  given  (non-random)  vector  v  e  IR'  its  projection 
along  r  is  such  that: 


(2.14) 


\*L( <  r ,v >  r)  =  v 


where  L(‘)  is  the  expected  value,  and  <  *,•  >  is  the  euclidean  inner 

V 

product  in  IR". 

-So  that  in  order  to  save  numerical  work  (i.e.  functions  evaluations) 
in  ;  2.12)  we  substitute  7Uj^)  with  the  "random  gradient" 


s 


t : .  1 '  i 


-{V  =  N  <  r,  7f(lk)  >  r 


Wo  note  that  since  ~  )  is  the  directional  derivative  in  the  direc- 

t ion  r,  it  is  computationally  much  cheaper  (e.g.  when  forward  differences 
are  used,  onlv  d  function  evaluations  are  needed  to  approximate  j_(£))- 
Hie  re  to  re,  the  paths  are  computed  approximating  f_(tk)  with  the  solution 
of  the  following  differences  equations: 


-k+ 1  — k 


!tkJ(^k+l  '  k  =  0,1 


where  • I  ",  i  is  a  finite  difference  (forward  or  central)  approximation 

-'■K ' 


to  •  ( 


The  complete  algorithm  is  described  in  the  next  section. 


-•*  :  V-. 
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i'he  complete  algorithm. 

We  g ive  in  sect.  .'..I  a  general  description  of  the  algorithm,  while 
implementation  details  are  given  in  sect.  5.2. 

3.1.  doneral  description  of  the  algorithm. 

Hie  basic  t u;ie- integrat ion  step  leu.,  id.  10)  and  sect.  5.2.1)  is 
used  to  generate  a  fixed  number  N™.  ,  of  tra  iector  ies ,  which  start  at 

1  ivV ) 

time  :ero  from  the  some  initial  conditions  with  possibly  different  values 
of  id)  (note  that  even  if  the  starting  values  ;(())  are  equal  the 
trajectories  evolve  differently  due  to  the  stochastic  nature  of  the  inte¬ 
gration  steps). 

The  trajectories  evolve  (simultaneously  but  independently)  during 
an  "observation  period"  having  a  given  duration  (sect.  5.2.5),  and  with¬ 
in  which  the  noise  coefficient  of  each  trajectory  is  kept  at  a  constant 
value  ,  while  the  values  of  the  steplength  h^  and  of  the  spatial 
li sc  ret i zat ion  increment  for  computing  the  random  gradient  (eq. 

2 . 1 f »  and  -wet.  5.2.2)  are  automatically  adjusted  for  each  traiectorv 
hv  the  algorithm  (sects.  5.2.5  and  5.2.41. 

\t  the  one  of  evorv  observation  period  the  corresponding  trajec¬ 
tories  are  compared,  one  of  them  is  discarded  (and  will  not  be  considered 
am  "(ore),  ill  other  trajectories  are  naturallv  continued  in  the  next 
’iiserv.it  ion  •vriod,  and  one  of  the  trajectories  is  selected  for  "branch¬ 
ing”  -ect.  5.2.0),  that  : s  for  generating  also  a  second  continuation 
t  rajectorv  :  i :  fering  ‘from  the  first  one  onl  v  in  the  starting  values  for 
and  x.  ; sect .  i.2. “  ,  and  which  is  considered  as  having  the  same 
"past  hi  'Ter”  f  r  h,e  f  i  e  -  r  one. 


in 


Hie  set  of  simultaneous  trajectories  is  considered  as  a  single  trial, 
which  is  stopped  as  described  in  sect.  3.2.8,  and  is  repeated  a  number  of 
tunes  with  different  operating  conditions  (sect.  3.2.9). 

Ilie  stopping  criteria  for  the  complete  algorithm  are  described  in 

sect . 

Ihe  use  of  an  admissible  region  for  the  x-values  is  described  in 
sect.  3.2.11,  scaling  is  described  in  sect.  3.2.12,  and  criteria  for 
numerical  equality  in  sect.  3.2.13. 

3.2.  implementation  details. 

3.2.1  ITie  time- integration  step. 

Hie  basic  time- integration  step  (.eq.  (2.1b))  is  used,  for  the  tra- 
jectorv  under  consideration,  in  the  form 

to.-.  1  .  1)  _k  +  1  =  ^  -  hk  ^.Uk)  +  ‘-p  ^  ^  •  ••  ) 

where  hk  and  -  are  the  current  values  of  the  steplength  ;md  of  the 
noise  coefficient  t the  noise  coefficient  has  a  constant  value  s  through¬ 
out  the  current  observation  period  (sect.  3.1)1;  uk  is  a  random  vector 
sample  from  an  N-dimensional  standard  C.aussian  distribution,  and 

►  Vi.  u.  =  w.  ,  -  w, 

due  to  the  properties  of  the  Wiener  process. 

idle  computat  ion  of  the  f  in i  te-di f ferences  r.-inuom  gradient  .  (r  ) 

»s  do<cr ihed  in  the  next  section. 
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4.  Numerical  Testing. 

SRMA  has  been  numerically  tested  on  a  number  of  test  problems  run 
on  two  computers.  The  test  problems  are  described  In  sect.  4.1,  the  com¬ 
puters  in  sect.  4.2  and  some  numerical  results  are  reported  in  sect.  4... 

1.1.  Test  problems. 

The  set  of  test  problems  is  fully  described  in  [10]  together  with 
the  initial  points;  the  test  problems  are; 

1.  A  fourth-order  polynomial  (N  =  1) 

2.  boidstein  sixth-order  polynomial  (N  =  1) 

3.  One -dimensional  penalized  Shubert  function  (N  =  1) 

4.  A  fourth-order  polynomial  in  two  variables  (N  =  2) 

3.  A  fmc t ion  with  a  single  row  of  local  minima  (N  =  2) 
t>.  Six  hump  camel  function  (N  =  2) 

7.  'Two-dimensional  penalized  Shubert  function  2  =  0  (N  =  2) 

8.  Two-dimensional  penalized  Shubert  function  3  =  0.5  (N  =  2) 

9.  Two -dimens icna 1  penalized  Shubert  function  3=1  (N  =  2) 

10.  A  function  with  three  ill-conditioned  minima  a  =10  (N  =  2) 

11.  A  function  with  three  ill-conditioned  minima  a  =  100  (N  =  2) 

12.  A  function  with  three  ill-conditioned  minima  a  =  1000  (N  =  2) 

15.  A  function  with  three  ill-conditioned  minima  a  =  10000  (N  =  2) 

11.  \  function  with  throe  il 1 -condit ioned  min una  a  =  10'  (N  =  2) 

15.  A  function  with  three  il  1 -condi t ioned  minima  a  =  10*’  (N  =  2] 

lo.  \'ldstoin-Pr:co  function  (X  =  2) 

Penalized  H ran m  fiuict  ion  i'N  =  2) 

Penal  i  zo.l  She! .  1  functicn  M  =  5 


is 


\  =  4) 
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a)  Relative  difference  criterion 

!x-y|  <  C I x i  +  | y  1 ) / - 

b)  Absolute  difference  criterion 

ix-y|  <  t<abs 

where  and  r,Rq  are  given  non -negative  tolerances. 
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Let  be  the  largest  eigenvalue  of  the  (symmetric  and  non-negative 

definite)  matrix  C. 

We  adopt  the  updating  matrix 

F,  =  6X  I  -  C 
A  i 

where  I  is  the  N*N  identity  matrix,  6  >  1  (3  =  1.3  in  the  present 
implementation),  and  we  obtain  the  updated  value  A'  of  A  by  means  of 
the  formula 

A'  =  oA 

where  a  is  a  normalization  factor  such  that  the  sum  of  the  squares  of 
the  elements  of  A'  is  equal  to  N  (as  in  the  identity  matrix). 

The  matrix  FA  seems  one  of  the  possible  reasonable  choices, 
since  it  is  positive  definite  for  3  >  1,  it  has  the  same  set  of  eigen¬ 
vectors  as  C,  its  eigenvalue  spectrum  is  obtained  from  the  spectrum  of 

Q  T 

C  by  reflection  around  X  =  — ^  ,  and  it  therefore  acts  in  the  right 

direction  to  counter  the  ill-conditioning  of  f. 

The  magnitude  of  the  counter-effect  depends  on  6:  the  adopted 
value  has  been  experimentally  adjusted. 

The  updated  bias  vector  b/  is  chosen  in  order  that  the  scaling 
at  x  does  not  alter  x,  i.e.  in  order  that 
a'x  +  b  =  Ax  +  b. 


3.2. 13  Criteria  for  numerical  equality. 

The  following  two  criteria  are  used  in  a  number  of  places  in  the 
algorithm  to  decide  if  two  given  numbers  x  and  y  are  sufficiently 
close  to  each  other  (within  given  tolerances)  to  be  considered  "numeri¬ 
cally  equal". 


Ac  consider  \ for  each  traiectorv)  the  rescaled  variable  x  =  Ax  +  b, 

a  he  re  \  is  the  rescaling  matrix  ana  b  is  a  bias  vector,  and,  instead  of 

i%o  "iin  iiai  r.e  with  respect  to  x  the  function  f  ( x  I  =  fix)  =  f(Ax  +  b), 

ana  ue  try  to  counter  the  i  I  1  -coin!  it  ion  ing  of  f  with  respect  to  x  by 

uitabi;.  luiusting  A  :  and  b  is  adjusted  in  order  not  to  alter  x)  . 

Hie  updating  of  A  is  obtained  bv  means  of  an  updating  matrix  F ^ , 

and  if  performed  at  the  end  of  an  observation  period  if  sufficient  data 

are  available  i see  below),  and  if  the  number  of  elapsed  observation  periods 

is  not  less  than  a  given  number  K  ,  and  greater  than  ~N) . 

pasca 

:'he  updating  matrix  !;  is  computed  as  described  below,  keeping  in 

mind  that  the  random  gradients  are  the  onlv  simplv-usuble  data  on  the 

nehavior  of  f  computed  by  the  algorithm. 

j et  i  =  i  '  \  be  the  column  vectors  of  the  components 

■  ( ;  i )  ’  g  ’ 

of  ill  the  X,  f  ini  te-di  l’ference  random  gradients  f  _F  or  j_°) 

r> 

evaluated  along  the  trajectory  (also  for  rejected  steps)  from  the  last 
sea !  mg . 

Lf  sufficient  data  are  available  (i.e.  if  X  A  dX^)  we  compute  the 
av  erage 


X  .  -  .  V  i ) 

■  I 


and  the  est  imate.i  covar i 


nice  matrix 


ich  ••  >  •<.  ms  t»  •  •'«.  i  reason  ible  indicator,  given  the  nailable  data,  of 
_■  i  \  =  r  s  .  •  .  1 1  -cendi  t  mning  '  .is  having  the  larger  eigenvalues 

Mwmtsd  i  r  h  t  h.e  di  r>vt  lens  dong  which  the  second  directional  deriva- 


We  note  that  each  integration  step  can  he  rejected  onlv  a  finite 
number  of  times,  each  observation  period  lasts  a  finite  number  of  accepted 
integration  steps,  and  there  is  a  finite  number  of  observation  periods  in 
a  trial;  ->ince  a  finite  number  of  trials  is  allowed,  the  algorithm  will 
stop  after  a  finite  total  number  of  steps  and  of  function  evaluations. 


o.i.ll  Admissible  region  for  the  x-values. 


In  order  to  help  the  user  in  trying  to  prevent  computation  failures 
(e.g.  overflown  the  present  implementation  of  the  method  gives  the  possi¬ 
bility  of  defining  i for  any  given  problem  and  machine  dynamic  range,  and 
based  on  possible  analytical  or  experimental  evidence)  an  admissible  region 
for  the  x-values  [hopefully  containing  the  looked-for  global  minimizer) 
within  which  the  function  values  may  be  safely  computed.  We  use  an 
.N-dimensiona l  interval 


\|I\ 

R  X  x. 
1  i 


•  ,  N, 


where  the  interval  boundaries  must  be  given  before  trial  start. 

'hit  .  !.e  the  admissible  region  the  function  fix)  is  replaced  be¬ 
an  exponent  ial iv  increasing  function,  in  such  a  wav  that  the  values  cl 
f  and  of  the  external  function  ire  matched  at  the  boundary  of  the  region. 


Seal  nig . 

[n  order  to  make  i  1 1 -con  i it  ioned  problems  more  tractable,  rescal ing 


is  oerformed  bv  the  ilgeritiim  a>  follows. 


the  preceding  trial,  according  to  the  outcome  (stopping  condition)  of  the 
preceding  trial  and  to  the  number  t  of  trials  performed  from  algorithm 
start,  as  compared  to  the  given  maximum  number  of  trials 
successful  stop:  :  =  10 3 
unsuccessful  unuem  stop: 

•  =  lb  if  t  i  |  (-/a)  Ntria,  I  1 
i  =  1')  otherwise, 

where  |fx||  is  the  smallest  integer  not  smaller  than  x 
unsuccessful  non-uniform  stop:  a  =  10““ 


Hie  initial  point 


is  selected  as  follows: 


U  t  !  |  1  -/-■)  ■V‘yR[,\[  ! 
otherwise  take  x,  =  x. 


take  the  value  of  x  at  algorithm  start 


diere  x  is  the  current  best  minimizer  found  so  far  from  algorithm 


start . 


All  other  initial  values  are  those  of  the  first  trial,  except  the 
initial  values  of  h  ind  which  are  the  values  reached  at  the  end  of 

the  preceding  trial. 


d_.li>  Stopping  criteria  for  the  algorithm. 


die  complete  algorithm  is  stopped,  at  the  end  of  a  trial,  if  a 


given  numner 


:it>cr  \  .....  has  been  reached  of  uniform  trial  stops  all  at  the 


.urrent  : '  level,  or  :n  am  case  if  a  maximum  given  number 
' l  trials  has  wen  reacheu. 

Success  i.~  claimed  Sv  the  algorithm  if  at  least  one  uniform  stop 


centred  it  tiie  current 


[  ev  e  1  , 
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and  the  best  minimum  function  falue  f^pp  found  so  far  from  algorithm 
start:  if  I'-ppyuy  ;*nd  tQp-p  satisfy  at  least  one  of  the  above  criteria, 

with  the  s;une  tolerances,  the  trial  is  considered  successful  at  the  level 
f(1pp  otherwise  the  trial  is  again  considered  unsuccessful. 

checking  of  the  stopping  criteria  is  activated  only  if  a  minimum 
given  number  observation  periods  has  been  reached. 


3.2.9  Characteristics  of  the  successive  trials. 


The  operating  conditions  which  are  changed  when  another  trial  is 
started  are: 

-  seed  of  the  random  number  generator 

-  maximum  duration  of  the  trial 

-  policy  for  choos mg  c  for  the  second  continuation  of  a  branched 

trajectory 

-  value  of  o  at  trial  start 

P 

-  initial  point  x  0 . 

The  maximum  duration  of  a  trial,  i.e.  the  maximum  number  NL,.,V 

['MAX 

.T  i ‘bsc-rvat  ion  periods,  is  obtained  as  follows: 

if  the  preceding  trial  had  a  uniform  stop  (sect.  3.2.8)  take  the 
value  of  the  preceding  trial 

otherwise  take  a  value  obtained  by  adding  to  the  preceding  value 
a  fixed  given  increment  lypjgyx- 

Die  policy  for  selecting  :  for  the  second  continuation  of  a 

branched  traiectorv  was  described  in  sect.  3.2.~. 


Die  value  of  at  the  start  of  a  new  trial  is  obtained  bv  means 

P 

of  a  multiplicative  updating  factor  t  applied  to  the  starting  value  of 


The  updating  factor  1:  for  is  as  follows: 

P 

for  the  first  trial  and  for  any  trial  following  an 
unsuccessful  trial 

T  =  HT'  ;  where  x  is  a  random  sample  from  a 
standard  normal  distribution 
for  all  other  trials 

f  =  w  '  where  y  is  a  random  sample  from  a 

standard  Cauchy  distribution,  i.e.  with  density 

fly)  =  1/M.l+y  ;J 

fhe  updating  factor  for  Ax,  is: 

3  z 

!•'.  =10  where  z  is  a  random  sample  1  rom  a  standard 

X 

normal  distribution, 

5.J.S  Stopping  criteria  for  a  trial. 

A  trial  ls  stopped,  at  the  end  of  an  observation  period,  and  alter 
having  discarded  the  worst  trajectory,  if  all  the  final  function  values 
of  the  remaining  trajectories  ("possibly  at  different  points  xj  are 
"numerical  lv  euual",  i.e.  if  the  maximum,  i'  and  the  minimum, 

i ;  .  LA  a 

'"n-AIlN’  ;lI!'on-'  irial  final  values  satisfy  at  least  one  of  the  criteria 
in  sect,  d . d .  1 ,  the  relative  difference  criterion  with  a  given  stopping 

tolerance  and/or  the  absolute  difference  criterion  with  given 

Kill. 

stopping  tolerance  '"uniform  stop  at  the  level  1 • 

iiie  trial  is  also  anvuay  stopped,  at  the  end  of  the  observation 
period .  if  a  maximum  given  number  N[V^  of  observation  periods  has  been 
reaehed  . 

in  the  latter  ease  the  trial  is  considered  unsuccessful ,  while  in 


the 


former  case  a  comparison  is  made  between  the  final  value  f 


a  trajectory 


from  the  point  oi  view  of  the  noise  coefficient 

P 

with  larger  is  considered  better  if  the  comparison  is  made  in  an 

earlv  observat  ion  period  las  lone  as  k  M  *1,  ,  where  k  is  the 
number  of  elapsed  obsen'ation  periods,  and  M^,!^  are  defined  below) 
and  worse  otherwise. 

A  basic  partial  ordering  of  the  trajectories  is  first  obtained  on 
the  basis  of  past  function  values,  ;ind  a  final  total  ordering  is  then  ob¬ 
tained,  if  needed,  by  suitably  exploiting  the  noise-based  ordering. 

Hie  discarded  trajectory  is  always  the  worst  in  the  ordering,  while 
the  trajectory  selected  for  branching  is  usually  not  the  best  one,  to 
avoid  to  be  stuck  in  a  non-global  minimum. 

Normal  branching  is  performed  on  the  trajectory  which,  in  the  order¬ 
ing,  occupies  the  place  lj  (a  given  integer);  exceptional  branching, 
where  the  best  trajectory  is  selected,  occurs  for  the  first  time  at  the 

end  of  observation  period  k  ,  and  then  even'  M  periods  (k  and 

1  po’  p  ^  v  po 

M  are  given  integers);  i.e.  exceptional  observation  periods  are  those 
numbered 


po 


M 


5.1.“  !Tie  -econo  cent  uuiat ion  of  a  branched  trajectory. 

’while  the  first  .unperturbed)  cent  ii  .vation  of  a  trajectory  that 
undergoes  branch ing  'tarts  with  the  current  values  of  and  \x.  ,  the 

p  k 

second  cent l nuat ion  -tarts  with  values  obtained  bv  means  of  multiplica¬ 
tive  random  updatin'.:  factors  nnpl  led  to  the  current  values. 


In  phase  ba : 


We  final Iv  remark  that  h,  and  x.  are  bounded  hv  suitable  con- 

rl  K. 

stants  to  avoid  computational  failures. 

b.J.j  Duration  of  the  observation  period. 

The  duration  of  observation  period  numbered  k  from  trial  start, 

vie  fined  as  the  number  \'j  of  time  integration  steps  in  period  k  ,  is 

^ sated  as  a  function  of  k  bv  means  of  a  formula  which  must  be  chosen 

P 

before  algorithm  start  among  the  following  three  formulas: 

1)  \,  -  1  +  [log, Ik  j )  (’’short"  duration) 

np  - 1  P 

2)  \,  =  (k-  '  ("medium-size"  duration) 

np  ‘  p  ' 

5)  N,  =  k  ("long"  duration) 

hp  p 

.-.here  k  =  I  ,J,  ...  ,  and  [x|  is  the  largest  integer  not  greater  than  x 
P  ' 

a.d.o  1'ra.iectorv  selection. 

In  order  to  decide,  at  the  end  of  an  observation  period,  which  tra¬ 
jectory  is  to  i'e  discarded,  and  which  one  should  be  selected  for  branch¬ 
ing,  we  compare  the  trajectories  on  the  basis  of  the  values  of  their  noise 
coefficient  in  the  observation  period,  and  of  the  function  values  obtained 
from  t r  in  1  ta  rt . 

from  the  point  of  view  of  past  function  values  a  trajectory  is  con- 
-i acred  hotter  than  another  if  it  has  attained  a  lower  function  value  than 
the  .  ther  i  excluding  a  poa-ible  initial  part  common  to  both  trajectories') . 
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We  test  f,  and  f,.  =  f,  +  .if,  for  nunencal  equality  according 

K.  K  tC  K. 

to  the  relative  difference  criterion  (sect.  5.2.15)  with  tolerances 
•  =  LIT"  and  '  =  10"',  and  take 

K  1  KZ 

■  =  2  if  f  and  f,  are  "equal"  within  :D. 

k  k  1  Rl 

-•  =  ’•  if  f,  and  f,  are  not  "equal"  within  ' 

k  k  R2 

i  =  1  otherwise. 

The  interval  (1()~J':,  10"')  has  been  adopted  since  it  contains  both 
the  square  root  and  the  cubic  root  of  the  machine  precision  of  most  com¬ 
puters  in  double  precision  (the  square  root  is  appropriate  for  forward 
differences,  while  the  cubic  root  is  appropriate  for  central  differences). 

Updating  factors  {  for  h^ 

In  phase  4a: 

V  =  1/1.05  for  the  first  attempt  to  the  first  half-step 

Y  =  1  for  the  second  attempt 

r  =  1/10  for  all  other  attempts 

In  phase  5  the  value  of  ,  depends  on  the  current  number  a  of  accepted 
time  integration  steps  in  the  current  observation  period,  and  on  the  cur¬ 
rent  total  number  r  of  half-steps  rejected  so  far  in  the  current  trial 
(excluding  those  possible  rejected  while  attempting  the  first  step). 

[f  r  >  0 

i=l  (if  a  <  2r) 

;  =1.1  (if  2r  <  a  ^  5r) 

j  —  2  (if  5r  <  a ) 

If  r  =  o 

,  =  2  (it"  a  =  1 ) 

,=10  (if  a  >  1) 


na.  If  the  halt --rep  is  rejectee :  reject  also  the  first  half-step, 
update  'decrease,'  h,  ,  and  go  hack  to  1. 

K 

Otherwise:  accept  the  whole  step  and  trv  the  next  one. 

dote  however  that  it’  the  same  half-step  is  rejected  too  manv  times 
the  half-step  is  nevertheless  accepted  in  order  not  to  ston  the  algorithm; 
this  is  not  too  harmful  since  several  trajectories  are  being  computed, 
and  a  "had"  one  •.-.ill  he  eventually  discarded  fin  the  present  implementation 
the  bound  is  given  explicitlv  for  the  first  half -step  (50  tunes'),  and  im- 

.  -  j  0 

plicitly  tor  the  second  halt -step  (if  h,  becomes  smaller  th:ui  ](J  )J. 


4  ihe  uodat  ing  of  h,  and  \x,  . 

K  K. 

Ine  t  ime- integration  step  length  h,^  and  the  spatial  discretization 
increment  \x,  for  the  trajectory  under  consideration  are  updated  while 
performing  the  integration  step,  as  described  in  the  preceding  section. 
Updating  is  always  performed  by  means  of  a  multiplicative  updating 


factor  which  is 

appl ied 

to 

the  old  value  to  obtain  the 

new  one. 

i’lie  magnitude  of 

the 

updating  factors,  as  used  in 

the  various 

uiuses  of  the  si 

as  uenc  e 

in 

the  nreced ing  sect .  5 . d . 5 ,  is 

as  follows: 

Updating  ! 

factors 

for  .x, 

i\ 

in  phase  1 b : 

=  iif 

In  phase  fa: 

=  ii) 

In  nha-e  Ih: 

=  !!)"• 

In  phase  ■  the  \ 

anted  function 

,aiue  of 

depends  on  the  magnitude  of 

the  current  esti 

r  C 

s  •  .  or  •  ,  as 
k  k. 

.  IK  ’ '  Tien 

l 

! .  -  ■  ,  x,  i  w  he  re  ,  i 

K  K.  K  rC 

n’nronr ; ate  1 ,  c 

id  the  func 

t  i  on  va  lue  f,  =  f  i  '  ,  1  . 
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All  attempts  are  with  the  current  li.e.  updated)  values  of 

-v 

Hie  sequence  of  attempts  is  as  follows: 

!.  Pick  up  a  random  unit  vector  r,. . 

—  f\. 

la.  i Compute  the  random  increment  s.,  (sect.  3 .2.2). 

lb.  If  s.  (and  therefore  Ax,  )  is  too  small  (i.e.  if  the  square 

-K.  rV 

of  the  euclidean  nonn  of  the  difference  between  the  computed 


and  the  forward-  and  central -differences  random  gradients 


13.:.:. 


3) 


-  N  r. 

K.  — K 


C  v  c 
.  =  \  n  »* 

— k.  k  — k 


, .  .  F  C  - 

ive  use  j i  or  ?l  tor 

"t\  — K 


if,)  in  the  first  half -step  as  described 


in  the  next  section. 


3.:. 3  Accepting  ;md  rejecting  the  half-steps. 

fhe  computation  of  the  first  half -step  can  be  attempted  with  the 
forward-  or  central -differences  random  gradient  (<  or  .  eq.  (3.:.:. 

"mV  — K 

as  described  below. 

In  either  case  the  half-step  is  accepted  or  rejected  according  to 
t  he  fune t  ion  i  nc  remen t 


f3.:.3.1) 


■ 


-  ny 


Since  A'Fk  should  be  non-positive  for  a  sufficiently  small  value 
of  h.  the  half-sten  is  rejected  if  A'f,  is  "numerically  positive", 
i.e.  larger  than  a  given  positive  small  tolerance. 

ihe  second  half -step  is  rejected  if  the  corresponding  function 
increment 


la.:..}.-) 


•  fk  =  ^ 


is  positive  and  tec  large  i  greater  than  100  in  the  present  imp 1  omen - 

P 

tat  ion  I  . 

The  sequence  of  attempts  affects  the  updating  of  h,_  and  Ax,  as 

K  K. 

de.-crihod  below;  the  amount  of  the  updating  is  described  in  sect.  3.:. 4. 
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19. 

Penalized 

Shekel  function  M  =  7 

(N  = 

4) 

20. 

Pena  1 i zed 

Shekel  function  M  =  10 

(N 

=  4) 

21  . 

Penal ized 

three-dimensional  Hartman  function  (N  =  3) 

>  •> 

Pena  1 i zed 

six-dimensional  Hartman 

function  (N  =  6) 

23. 

Penal ized 

Levy- Montalvo 

function , 

type 

1 

(N  =  2) 

24. 

Pena  1 1  zed 

Levy- Montalvo 

function, 

type 

1 

(N  =  3) 

25 . 

Penal ized 

Levy- Montalvo 

function, 

type 

1 

(N  =  4) 

2b. 

Pena  1 1  zed 

Levy- Montalvo 

function, 

type 

2 

(N  =  5) 

2~ . 

Pena  1 1 zed 

Levy-Montalvo 

function. 

type 

2 

(N  =  8) 

28. 

Pena  1 ized 

Levy- Montalvo 

function, 

type 

■> 

“  > 

(N  =  10) 

29. 

Pena  1 i zed 

Levy-Montalvo 

function , 

type 

3, 

range  10  (N 

=  2) 

30. 

Pena  1 1 zed 

Levy-Montalvo 

function, 

type 

3, 

range  10  (N 

=  3) 

31. 

Pena  1 1  zed 

Levy-Montalvo 

function, 

type 

3, 

range  10  (N 

=  4) 

32 . 

Penal i zed 

Levy-Montalvo 

function, 

type 

3, 

range  5  (N  = 

5) 

33. 

1  ena  1 1  zed 

Levy-Montalvo 

function, 

type 

3, 

range  5  (N  = 

6) 

34. 

Penal  ized 

Levy-Montalvo 

function , 

type 

3, 

range  5  (N  = 

7) 

35.  A  function  with  a  cusp-shaped  minima  (N  =  5) 

'<i.  A  function  with  a  global  minimum  having  a  small  region 
of  attraction  a  =  100  (N  =  2) 

37.  A  time t ion  with  a  global  minimum  having  a  small  region 
of  attraction  a  =  10  (N  =  5) 

We  used  the  above  functions,  and  the  standard  initial  points  as 
thev  are  coded  in  the  subroutines  ilI.OMTF  and  lil.GMIP,  which  are  available 


in  [101. 
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4.2.  Test  computers. 

We  considered  two  typical  machines  of  "large"  and  "small"  dynamic 
range,  that  is,  with  11  and  8  bits  for  the  exponent  ("biased  or  signed) 
of  double  precision  numbers,  and  corresponding  dynamic  range  of  about 

+308  +38 

10  and  10  .  me  tests  were  actually  performed  on: 

—  UNI  VAC  1100/82  with  EXEC  8  operating  system  and  FORTRAN  (.ASCII) 
computer  (level  10R1)  ("large"  dynamic  range) 

—  D.E.C.  VAX  11/750  with  VMS  operating  system  (vers.  3.0) 
and  FORTRAN  compiler  (vers.  3)  ("small"  dynamic  range) 

4.3.  Nume  r ica 1  re  sul ts . 

Numerical  results  of  running  SIGMA  on  the  above  problems  and  on  the 
above  machines  are  described  below.  All  results  were  obtained  under  the 
following  operating  conditions. 

The  easy-to-use  driver  subroutine  SIGMA1  (described  in  the  accompany¬ 
ing  algorithm)  was  used,  with  Ng^  =  1,2, 3, 4, 5.  All  numerical  values  used 
for  the  parameters  are  set  in  the  driver  SICMAl  and  in  the  other  subroutines 
which  are  described  in  the  accompanying  Algorithm. 

.All  numerical  results  are  reported  on  Tables  1,  2,  and  3.  Table  1 
reports  some  performance  data  (i.e.  output  indicator  IOUT  and  nunber  of 
functions  evaluations)  as  obtained  from  SIGMA  output  for  each  of  the  37 
test  problems  and  for  the  testing  both  on  the  "large"  and  "small"  dynamic 
range  machines.  In  order  to  evaluate  the  perfoxmance  of  SICMA  we  consider 
all  the  cases  in  which  the  program  claimed  a  success  (output  indicator 
LOUT  >  ())  or  a  failure  (IOUT  S  0)  and  —  by  comparing  the  final  point 


with  the  known  solutions  —  we  identify  the  cases  in  which  such  a  claim 
is  clearly  incorrect  (i.e.  success  claim  when  the  final  point  is  not  even 
approximately  close  to  the  known  solution,  or  failure  claim  when  the  final 
point  is  practically  coincident  with  the  known  solution).  It  is  also 
meaningful  to  consider  all  the  cases  in  which  a  computational  failure 
due  to  overflow  actually  occurrs  at  any  point  of  the  iteration. 

Table  2  and  Table  3  report  for  each  problem  and  summarized  for  all 
problems  data  concerning  the  effectiveness,  dependability  and  robustness 
—  in  the  form  of  total  numbers  of  correctly  claimed  successes,  correctly 
claimed  failures,  incorrect  success  or  failure  claims  and  total  number  ot 
overflows  —  for  the  two  machines. 


Table  1  (continued) 
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NPROB  =  problem  number  given  in  sect.  4.1.  NSUC  =  see  sect.  3.2.10. 

le  =  0  success  ( IQUT  >  0)  (claimed  by  SICMA)  Nf  =  total  number  of  function  evaluations  including 

=  1  failure  ( I  OUT  0)  (claimed  by  SMMY)  the  "lies  needed  o  cc.  pate  the  "ninJom"  gredent 
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Table  2  (continued) 

UN I VAC  (continued) 

NS|lt: _ 1 _ 2 _ 3 _  4 _ S 

NPROB  N 

1  1  1  1  i 

3  1111 

3  1111 

1111: 
1111 
5  111 

1111. 

3  3  3  3 

5  3  3  3 


29  2 

30  3 

51  4 

52  5 

33  t> 

34  7 

35  5 

36  2 

37  5 
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Table  2  (continued) 

VAX  (continued) 


2'J  2  1  1  1  1  1 

30  311111 

31  4  1  1  1  1  1 

3J  5  1  1  1  1  1 

33  o  1  1  1  1  1 

34  7  1  1  1  1  1 

335  1  1  1  1  1 

5o  2  3  3  3  3  3 

37  5  3  3  3  3  3 


1  =  success  correctly  claimed 
5  =  failure  correctly  claimed 
3  =  incorrect  claim 


4  =  overflow 


TABLE  3 
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3.  Conclusions. 


The  SIGMA  package  presented  here  seems  to  perform  quite  well  on 
the  proposed  test  problems. 

As  it  is  shown  in  [10]  some  of  the  test  problems  are  very  hard; 
for  example,  Problem  18  (N  =  10)  has  a  single  global  minimizer  and  a 
number  of  local  minimizers  of  order  1010  in  the  region  jx^j  <  10 
i  =  I,!,  ...  ,  10. 

Fable  1  shows  that  from  the  point  of  view  of  the  effectiveness 
measured  by  the  number  of  correctly  claimed  successes  the  performance 
of  Si  GALA  is  very  satisfactory;  moreover,  it  is  remarkably  machine  inde¬ 
pendent  (note  that  completely  different  pseudo- random  numbers  sequenc- 
are  generated  by  the  algorithm  on  the  two  test  machines).  The  result:. 
Fable  1  also  suggest  that  the  performance  of  SIGMA  is  very  satisfacu 
from  the  point  of  view  of  dependability  (only  2  incorrect  claims  on  the 
"large"  dyruuuic  range  machine  when  >  3  and  on  the  "small"  dynamo 

range  machine  when  >  4)  and  robustness  (no  overflows  on  both 

machines) . 

Unfortunately,  given  the  state  of  the  art  on  mathematical  softw.*., 
*.  *r  global  optimization,  it  has  not  been  possible  to  make  conclusive  •.;• 
p:  iris  on  s  with  o  t  her  packa  ges  . 

finally,  we  note  that  a  smaller  value  of  gives  a  much  ch  - 

'net hod  I  less  function  evaluations)  at  the  expense  of  a  loss  in  effect iv- 


;reater  number  of  failures). 
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1.  PURPOSE 


The  SICMA  package  is  a  set  of  FORTRAN  subprograms,  using  doub’ 
precision  floating-point  arithmetics,  which  attempts  to  find  a  glob 
minimizer  of  a  real-valued  function  f(x)  =  f(Xp  ...  ,  x^)  of  N 
real  variables  x . x.,. 
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2 .  METHOD 


The  algorithm  used  by  SICMA  is  described  in  detail  in  ref.  [1] . 
A  global  minimizer  of  f(x)  is  sought  by  monitoring  the  values 
of  f(x)  along  trajectories  generated  by  a  suitable  discretization 
of  the  stochastic  differential  equation 
dC  =  -7f(£)dt  +  e(t)dw 
with  initial  condition: 

C(0)  -  Xq 

where  7f  is  the  gradient  of  f,  w(t)  is  an  N-dimensional  standard 
Wiener  process,  and  the  "noise  coefficient"  eft)  is  a  positive  func¬ 
tion.  The  discretization  has  the  form 


ik+i  -  hki(4)  +  V  k  =  °>1>2> 

^0  =  *o 

where  is  the  time  integration  step  length,  ^  y  (£.  )  is  computed  as 
a  finite-differences  approximation  to  the  directional  derivative  of  f 
in  a  randomly  chosen  direction,  and  u^  is  a  random  sample  from  an  N- 
Jimensional  standard  gaussian  distribution. 

We  consider  the  simultaneous  evolution  of  a  number  Nj-raj  °f  tra' 
iectories  during  an  "observation  period"  having  the  duration  of  a  given 
number  of  time  integration  steps,  and  within  which  the  noise  coeffi¬ 

cient  c(t)  of  each  trajectory  is  kept  at  a  constant  value  e  ,  while 
the  stenlength  h^  and  the  spatial  increment  Ax^  for  computing 
are  automatically  adjusted  for  each  trajectory  by  the  algorithm. 

At  the  end  of  every  observation  period  a  comparison  is  made  between 


the  trajectories:  one  of  the  trajectories  is  discarded,  all  other  tra¬ 
jectories  are  naturally  continued  in  the  next  observation  period,  and  one 
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of  them  is  selected  for  "branching",  that  is  for  generating  also  a  second 
continuation  trajectory  which  differs  from  the  first  one  only  in  the  start¬ 
ing  values  for  e  and  Ax,  ,  and  is  considered  as  having  the  same  "past 
P  K 

history"  of  the  first. 

The  number  ^XRAJ  simultaneously  evolving  trajectories  remains 
therefore  unaffected,  and  the  second  continuation  trajectory  takes  the 
place,  from  a  program- implementation  point  of  view,  of  the  discarded  tra¬ 
jectory. 

The  set  of  simultaneous  trajectories  is  considered  as  a  single 
trial,  and  the  complete  algorithm  is  a  set  of  repeated  trials.  A  single 
trial  is  stopped,  at  the  end  of  an  observation  period,  if  a  maximum  given 


number  NpMAX 


of  observation  periods  has  been  reached,  or  if  all  the 


final  values  of  f(x)  (except  for  the  discarded  trajectory)  are  equal 


(within  numerical  tolerances,  and  possibly  at  different  points  x)  to 


their  minimum  value  ("uniform  stop"  at  the  level  f-pKNUN^ '  In 

the  former  case  the  trial  is  considered  unsuccessful,  while  in  the  latter 


case  a  comparison  is  made  between  the  common  final  function  value  ffp^uy 
and  the  current  best  minimum  function  value  £qpj  found  so  far  from 
algorithm  start:  if  fyp.jjjvj  >  fgpj  'the  trial  is  again  considered  unsucces- 
ful;  and  if  fq^FNlIN  =  ^OPT  (wathin  numerical  tolerances)  the  trial  is 
considered  successful  at  the  level  fgpp. 

The  trials  are  repeated  with  different  operating  conditions  (initial 


point  Xq ,  maximum  trial  length  XpN^ ,  seed  of  the  noise  generator, 
policy  for  selecting  the  starting  values  for  £p  in  the  second  continua¬ 
tion  trajectory  after  branching,  and  trial-start  values  for  e  )  and  the 
complete  algorithm  is  stopped  —  at  the  end  of  a  trial  —  if  a  given 


number  N's^,  of  uniform  stops  at  the  current  f gpj,  level  has  been  ob¬ 
tained,  or  if  a  given  maximum  number  N~T,T  of  trials  has  been  reacheu: 
success  of  the  algorithm  is  claimed  if  at  least  one  uniform  stop  occurred 


1 


at  the  final  value  of  f, 


OFT 


a 


i 


■  v-"-;  '-/y  '[vv/.’-y .-*■  yy.y"-'  ^ 
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3.  DESCRIPTION  OF  THE  PACKAGE 

The  algorithm  used  by  SIGMA  (see  sect.  2  and  ref.  [1])  has  been 
coded  in  the  form  of  a  set  of  FORTRAN  subprograms,  using  double-precision 
floating-point  arithmetics,  which  are  described  below. 

3.1.  Language 

All  the  coding  is  written  in  FORTRAN  IV  and  meets  the  specifications 
of  PFORT,  a  portable  subset  of  A. N.S.  FORTRAN  (ref.  [2]).  The  FORTRAN 
implicit  type  definition  for  integers  is  used  throughout;  all  non- integer 
variables  are  double  precision. 

3.2.  Description  of  the  Subprograms 

The  SICMA  package  consists  of  a  principal  subroutine  SIGMA,  a  set 
of  27  auxiliary  subroutines,  INIT,  REINIT,  TRIAL,  GENEVA,  PERIOD,  BRASI, 
ORDER,  CCMPAS,  STEP,  SSTEP,  NEWH,  DERFOR,  DERCEN,  RCLOPT,  STOOPT,  RANGE, 
INISCA,  NOSCA,  SEGSCA,  VARSCA,  CLMSCA,  ACTSCA,  MOVSCA,  UPDSCA,  ALKNUT, 
GAUSRV,  UNITRV;  a  set  of  7  auxiliary  functions,  IPREC,  IPRECE,  FUNCT0, 
ITOLCH,  EIGSCA,  CHAOS,  UNIFRN;  and  a  driver  subroutine  SIOlAl  calling 
SIGMA.  The  subprograms  are  described  below,  The  user  interested  only  in 
the  use  of  SIGMA  may  jump  to  Section  4. 

We  may  group  the  subprograms  as  follows. 

a)  Subprograms  for  the  numerical  integration:  STEP,  SSTEP,  DERFOR, 
DERCEN,  FUNCT0 ,  RANGE,  NEWH.  The  value  of  the  function  f(x)  is  computed 
—  whenever  required  in  the  numerical  integration  process  —  by  calling  the 
function  FUNCT0.  FUNCT0  rescales  the  variables  bv  calling  VARSCA  (see  d) ) , 
calls  RANGE  to  take  care  of  the  cases  where  the  current  point  x  is 
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outside  the  admissible  range  ([1],  sect.  3.2.11)  calls  the  user-supplr  I 
function  FUNCT  (sect.  4.5.1)  to  compute  f(x),  and  possibly  updates  me 
best  current  function  minimum  f^pT  and  the  corresponding  minimizer  x,,M|. 
by  calling  STOOPT  (see  c)).  The  basic  step  of  the  numerical  integrat :  n 
is  performed  by  SSTEP  which  calls  FUNCT0  to  compute  the  value  of  f (y ' , 
and  UNITRV  (see  e))  to  compute  the  random  direction  along  which  the  direc¬ 
tional  derivative  is  to  be  computed  (see  [1],  sect.  3.2.2);  the  directional 
derivatives  are  computed  numerically  by  SSTEP,  with  forward  or  central 
finite  differences,  by  calling  DERFOR  or  DERCEN,  which  call  FUNCT0;  the 
first  half-step  ([1]  ,  sect.  3.2.1)  is  accepted  or  rejected  ([1],  sect.  3.2.3 
bv  calling  N'HIVH  which  also  provides  the  updated  value  of  the  time  inte¬ 
gration  steplength  h,  ;  SSTEP  also  updates  the  cumulated  scaling  data  ([1], 
sect.  3.2.12)  by  calling  QJMSCA  (see  d)),  and  updates  the  spatial  discreti¬ 
zation  increment  based  on  the  results  of  calling  ITOLCH.  The  second 

half-step  ([1],  sect.  3.2.1)  is  performed  by  SSTEP  by  calling  GA.USRV 
(see  e))  and  c^.  be  accepted  or  rejected  ([1],  sect.  3.2.3).  The  subrou¬ 
tine  STEP  performs  the  single  integration  step  for  each  one  of  the  simul¬ 
taneous  trajectories  by  repeatedly  calling  SSTEP. 

b)  Subprograms  for  the  selection  of  the  trajectories:  BRASI,  ORDER, 
[PREC,  IPRECE,  COMPAS.  The  selection  process  for  the  trajectories  ([1], 
sect.  3.2.t>)  is  performed  by  the  subroutine  BRASI.  BR4SI  first  updates 
the  trajectory'  data  corresponding  to  the  elapsed  observation  period,  and 
then  asks  for  an  ordering  of  the  trajectories  by  calling  ORDER.  ORDER 
obtains  the  ordering  by  comparing  two  trajectories  on  the  basis  of  the 
past  history,  (by  calling  [PREC) ,  and  of  the  value  of  the  noise  coefficient 
(by  calling  IPRECE)  (fl],  sect.  3.2.6).  Based  on  the  ordering  provided 


7 


by  ORDER,  BRAS I 

1)  discards  one  of  the  trajectories 

2)  performs  a  branching  on  another  trajectory,  i.e.  the 
trajectory  to  be  branched  gives  rise  to  two  "continuation" 
trajectories:  the  first  one  is  unperturbed,  and  the  second 

one  has  modified  values  for  e  and  for  the  initial  Ax,  ; 

P  k 

the  modified  values  are  obtained  from  the  old  ones  by  means 
of  random  multiplicative  factors  which  are  computed  with  the 
aid  of  random  number  generator  function  CHAOS  (see  e) ) . 

Since,  from  a  program  implementation  point  of  view,  the  new  trajectory 
is  "moved"  in  the  "position"  of  the  discarded  one,  all  the  trajectory 
parameters  must  be  moved  to  the  new  position.  This  is  performed  directly 
by  BRASI  for  all  the  trajectory  data,  except  for  the  scaling  data  which 
are  moved  by  MOVSCA  (see  d)).  Finally  BRASI  calls  COMPAS  in  order  to  examine 
the  stored  data  about  past  trajectories  from  the  point  of  view  of  their 
utility  to  the  only  user  of  such  data,  which  is  the  subroutine  IPREC,  and 
irrelevant  data  are  discarded. 


c)  Subprograms  for  general  management  of  the  complete  algorithm: 
SICMA,  INIT,  REINIT,  TRIAL,  GENEVA,  PERIOD,  ITOLCH,  RCLOPT,  ST0OPT. 


GENEVA  performs  the  generation  of  the  set  of  trajectory  segments 
corresponding  to  the  current  observation  period  and  the  final  processing 
and  evaluation  of  the  trajectories.  GENEVA  first  updates  the  scaling 
arrays  containing  A  and  b  ([1],  sect.  3.2.12)  by  calling  SEGSCA  and 
UPDSCA  (see  d) ) .  The  generation  of  the  trajectory  segments  is  performed 
by  GENEVA  by  calling  PERIOD. 
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PERIOD  first  computes  the  duration  (in  accepted  steps)  of  the  observation 
period,  computes  all  the  integration  steps  by  repeatedly  calling  STEP  (see 
aj)  ana  finally  performs  the  trajectory  selection  by  calling  BRASI  (see  b)). 

Finally  GENEVA  determines  some  end -of -segment  results  (FPFMIN,  FPFMAX, 
XPFMIN,  see  sect.  4.5.d)  using  the  rescaling  capabilities  of  SEGSCA  and 
V.ARSCA  (see  d) ) . 

ilie  subroutine  TRIAL  generates  a  trial  by  repeatedly  performing,  for 
even-  observation  period, 

a  call  to  GENEVA  which  generates  the  simultaneous  trajectory 
segments,  and  performs  the  trajectory  selection, 
a  (possible)  call  to  PTSEC  which  performs  end -of -segment  output, 
a  check  of  the  (trial)  stopping  criteria,  with  the  aid  of  the 
function  ITOLCH, 

a  decision  about  activating  or  deactivating  the  scaling  of  the 
variables  (actions  performed  by  calling  ACTSCA  or  NOSCA) . 

The  subroutine  SICMA  is  the  principal  subroutine  of  the  package 
and  is  the  only  one  which  must  be  called  by  the  user  (apart  from  the  driver 
1  ■  MX  1 ,  sect.  4.1). 

SKMA  .manages  the  execution  of  the  complete  algorithm,  i.e.  of  a 
sequence  of  repeated  trials  performed  by  varying  a  number  of  operating 
conditions.  SIGMA  initializes  the  first  trial  by  calling  INIT,  and  the 
other  trials  bv  calling  REINIT. 

For  each  trial  the  subroutine  SI(MA 

onanies  or  prevents  a  future  activation  (within  the  current  trial) 
of  the  'Ca ling  of  the  variables  bv  calling  INISCA  or  NOSCA 
actual  1  executes  the  trial  by  calling  TRIAL 
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. I STOP;  =  1  relative  difference  criterion  satisfied 
=  2  absolute  difference  criterion  satisfied 
=  3  both  criteria  satisfied 

The  sign  of  I3T0P  indicates  the  relationship  between  the  end-of -trial 
value  FTFMIN  and  the  best  current  minimum  value  FOPT  (which  is  updated 
whenever  a  function  value  is  computed) . 

I STOP  >  0  FTFMIN  is  numerically  equal  (with  respect  to  at 

least  one  of  the  above  difference  criteria)  to  FOPT. 

I STOP  <  0  FTFMIN  is  not  even  numerically  equal  to  FOPT  (and 

therefore  cannot  be  considered  an  acceptable  estimated 
global  minimum). 

Isl'OPT  is  the  value  of  the  trial  stopping  indicator  ISTOP  correspond¬ 
ing  to  the  (current  or  past)  trial  where  FTFOPT  was  obtained,  with 
the  sign  which  is  updated  according  to  the  comparison  between  FTFOPT 
and  the  present  value  of  FOPT,  as  described  above.  The  final  value 
of  ISTOPT  is  returned  by  SIGMA  as  the  value  of  the  output  indicator 
l OUT  (whenever  the  algorithm  was  started,  IOUT  f  -99,  see  above). 

ITie  subroutine  definition  statement  of  PTKSUC  is 
SUBROUTINE  PTKSUC  (KSUC) 

whe  re 

KSUC  is  the  integer  variable  (1  <  KSUC  <  NSUC) 
defined  above. 

If  [PRINT  <  0  no  calls  are  made  to  the  output  subroutines. 

A  user  not  interested  in  the  use  of  any  one  of  the  output  subrou¬ 
tines  must  -provide  the  corresponding  dummy  subroutine  (with  RETURN  as 
the  only  executable  statement)  in  order  to  lvoid  unresolved  references 


p renlems. 


FOIT  is  the  current  best  minimum  value  of  f  found  from  algor ithm 
start  C ^oPt)  is  updated  whenever  a  function  value  f(x) 

is  computed) . 

FTfMIN ,  FrFMAX  are  respectively  the  minimum  and  the  maximum  value 
of  f(x)  among  the  end-of -trial  values  obtained  at  the  final 
points  of  the  last  trajectories  of  the  current  trial  (f-ppMAX' 

fTFMIN')  • 

FTFOPT  is  current  minimum  value  of  FrFMIN  among  the  trials  which 
did  not  stop  due  to  the  stopping  condition  related  to  NPMAX 
(stopping  indicator  ISTOP  =  0,  see  below).  FTFOPT  is  used  by 
SIGMA  to  compute  the  input  parameter  KSUC  for  the  subroutines 
PTKSUC ,  see  below. 

ISTOP  is  the  indicator  of  the  stopping  condition  of  the  trial ,  as 
follows: 

ISTOP  =  0  The  maximum  number  NPMAX  of  observation  periods 
has  been  reached. 

ISTOP  ?  0  all  the  final  values  of  f(x)  of  the  last  obser¬ 
vation  period  (except  for  the  just  discarded  tra¬ 
jectory)  are  close  enough  to  their  common  minimum 
value  FPFMIN,  with  respect  to  an  absolute  or  rela¬ 
tive  difference  criterion,  ([1],  sect.  3.2.13), 
to  be  considered  numerically  equal. 

If  ISTOP  f  0  the  absolute  value  and  the  sign  of  ISTOP  have  the 

following  meaning: 

The  absolute  value  indicates  which  of  the  difference  criteria 


was  satisfied 
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taken  place,  if  NSUC  (input  parameter  to  SIGMA)  had  been  given  a  (lower) 
value,  equal  to  the  current  KSUC. 

The  subroutine  PTKSUC  is  called  only  if  IPRINT  >  0  and  KSUC  <  NSUC. 
The  subroutine  definition  statement  of  PTSEG  is 

SUBROUTINE  PTSEG  (N,  XPFMIN,  FPFMIN,  FPFMAX ,  KP,  NFEV) 

where 

N  is  the  dimension  of  the  problem 

FPFMIN  and  FPFMAX  are  respectively  the  minimum  and  the  maximum  value  of 
f(x)  among  the  values  obtained  at  the  final  points  of  the  trajec¬ 
tory  segments  of  the  current  observation  period  (excluding  the  dis¬ 
carded  trajectory) . 

XPFMIN  is  the  N-vector  containing  the  coordinates  of  the  final  point 
(or  possibly  one  of  the  points)  where  the  function  value  FPFMIN 
was  obtained. 

KP  is  the  total  nunber  of  elapsed  observation  periods  in  the  current 
trial . 

NFEV  is  the  total  number  of  function  evaluations  performed  from  algorithm 
start . 

The  subroutine  definition  statement  of  PTRIAL  is 

SUBROUTINE  PTRIAL  (N,  XOPT,  FOPT,  FTOIIN,  FPFMAX,  FTFOPT, 

ISTOP,  ISTOPT,  NFEV,  KP,  IPRINT) 

where 

N  is  the  dimension  of  the  problem 

XOPT  is  an  N-vector  containing  the  coordinates  of  the  point  (or  possibly 
one  of  the  points)  where  the  current  best  minimum  FOPT  was  obtained 


'^opt'  • 


i 
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alleviate  the  efficiency  problems  connected  to  the  use  of  the  explicit 
Euler  step  on  ill-conditioned  functions. 

It  is  also  recommended  to  avoid  whenever  possible  to  provide  func¬ 
tions  such  that  the  "typical"  values  of  the  function  and  the  coordinates 
(rough  average  values  in  the  region  of  interest)  differ  from  unity  by  too 
many  orders  of  magnitude.  Such  a  care  is  generally  advisable  due  to  some 
numerical  values  adopted  in  the  FORTRAN  implementation,  for  example  to 
avoid  overflow,  but  may  be  absolutely  necessary  when  using  the  driver  sub¬ 
routine  SICMA1,  due  to  the  adopted  general  purpose  default  values  for  some 
input  data,  for  example  the  stopping  tolerances. 

4.5.2.  The  Output  Subroutines. 

Apart  from  the  output  parameters  in  the  call  statement  for  SIGMA,  the 
package  is  designed  to  be  able  to  perform  external  output  also  by  means  of 
the  calls  to  three  output  subroutines  which  must  be  supplied  by  the  user: 
PTSEG,  PTRIAL,  and  PTKSUC.  The  calls  are  activated  according  to  the  value 
of  the  control  parameter  IPRINT  (sect.  4.2). 

The  subroutine  PTSEG  is  called  (if  IPRINT  >  0)  at  the  end  of  every 
observation  period. 

The  subroutine  PTRIAL  is  called  (if  IPRINT  >  0)  at  the  end  of  every 

trial . 

The  subroutine  PTKSUC  is  called  only  at  the  end  of  every  sucessful 
trial  such  that  an  increment  occurred  in  the  value  KSIJC  of  the  maximum  num¬ 
ber  of  trials  which  had  a  uniform  stop  all  at  the  same  (current  or  past) 
value  of  fQpjG  a  call  to  PTKSUC  therefore  provides  the  user  with  the  oper¬ 
ationally  interesting  information  that  a  final  success  claim  would  have 


4.5.  User-supplied  Subprograms . 

The  user  must  provide  the  function  FUNCT  which  must  compute  the 
value  of  f(x)  (sect.  1),  and  the  three  output  subroutines  PTSEG,  PTRIAL, 
PTKSUC.  Hie  above  subprograms  are  described  below:  all  non-integer 
arguments  are  double  precision  (integer  arguments  are  indicated  by  means 
of  the  FORTRAN  implicit  type  definition) . 

4.5.1.  The  function  FUNCT 

FUNCT  must  return  as  its  value  the  value  at  x  of  the  function 
f  to  be  minimized. 

The  function  definition  statement  is 

DOUBLE  PRECISION  FUNCTION  FUNCT  (N,X) 

where 

N  is  the  (input)  dimension  of  the  problem 

X  is  the  (input)  N- vector  containing  the  coordinates  of  the 
point  x  where  the  value  of  f  is  to  be  computed. 

Note  that  the  function  f(x)  should  comply  with  the  growth  conditions  (2.3), 
(2.4)  of  [1],  otherwise  the  function  must  be  suitably  modified;  this  may 
be  performed  by  simply  adding  a  penalization  function,  which  must  be  zero 
on  the  region  of  interest.  We  note  that  this  device  can  be  used  also  to 
suitably  restrict  the  search  region  (for  example  in  the  case  of  periodic 
functions)  . 

It  should  be  also  noted  that  —  although  some  form  of  automatic 
rescaling  is  provided  by  the  algorithm  —  it  is  certainly  advisable  to 
avoid  whenever  possible  to  provide  unnecessarily  ill-conditioned  functions 
(for  example,  due  to  careless  choice  of  physical  units),  in  order  to 
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4.4  The  Driver  Subroutine  SIGMA1 

In  order  to  both  give  an  example  of  how  to  use  SIGMA,  and  to 
save  the  average  user  the  effort  of  deciding  the  numerical  values  for 
all  the  input  parameters  of  SIGMA,  a  driver  subroutine  SIGMA1  is  included 
in  the  package.  SIGMA1  simply  calls  SIGMA  after  assigning  default  values 
to  a  number  of  input  parameters.  The  subroutine  definition  statement  is: 

SUBROUTINE  SIGMA1  (N,  X0,  NSUC,  IPRINT,  XMIN,  FMIN,  NFEV,  I OUT) 
where  the  parameters  have  the  same  meaning  as  in  SIGMA. 

All  the  other  input  parameters  of  SIGMA  are  assigned  default 
values  within  SIGMA1  as  follows: 

H  =  10"10 
EPS  =  1 
DX  =  10 '9 
IRAND  =  0 
NTRAJ  =  0 
ISEGBR  =  0 
KPBR0  =  0 
INKPBR  =  0 
NPMIN  =10 
NPMAX0  =  100 
INPMAX  =  50 

NTRIAL  =  max(50 ,5*NSUC) 

TOLREL  =  10' 3 
TOLABS  =  10 *6 

KPASCA  =  10  (if  N  <  5) ;  =  300  (if  N  >  5) 

INHP  =  1 

XRMIN(I)  =  -104  (I  =  1 , . . . ,N) 

XRMAX(I)  =  104  (I  =  1 , . . . ,N) 


NPMIN  (say  5  <  NPMIN  <  100) 

NFMAX0  (say  0  <  NPMAX0  <  150) 

NTRIAL  (say  NTRIAL  >  50  and  NTRIAL  >  5-NSUC) 

INPMAX  (say  30  <  INPMAX  <  100) 

The  following  parameters  have  a  marked  effect  on  package  performance 
and  computational  effort: 

INHP,  NTRAJ,  ISEGBR,  INKPBR,  NSUC. 

Hie  magnitude  of  the  effect  roughly  decreases  from  left  to  right. 

In  order  to  avoid  untolerable  growth  of  the  computation  effort  or 
an  unacceptable  degradation  of  the  performance,  the  user  is  advised  to 
modify  (if  needed)  the  above  parameters  starting  from  NSUC,  based  on 
information  from  the  output  subroutines  (PTRIAL  and  PTKSUC) .  Note  that 
NSUC  is  the  only  "free"  control  parameter  of  the  driver  SIGMA1  (Sect.  4.4). 

The  value  of  KPASCA  should  be  based  on  possible  analytical  or 
experimental  evidence  on  the  ill -scaling  of  the  function  f(x) .  Choose  a 
small  value  (say  10)  for  a  badly  scaled  function,  a  large  value  (say  300) 
for  a  very  well  scaled  function.  The  N-dimensional  interval  (XRMIN,  XRMAX) 
should  be  as  large  as  possible,  consistently  with  the  purpose  of  avoiding 
computation  failures  (e.g.  overflow).  Finally  we  note  that  due  to  the 
joint  operation  of  the  stopping  conditions  for  the  trial  (see  [1],  sect. 
3.2.8),  in  order  to  use  only  one  of  the  conditions  it  is  sufficient  to 
put  to  zero  the  threshold  tolerance  (TOLREL  or  TOLABS)  of  the  other  con¬ 
dition.  Suggested  default  values  of  most  input  parameters  are  provided 
in  the  driver  subroutine  SICMA1  (sect.  4.4). 
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XMIN  is  an  output  N-vector  containing  the  coordinates  o£  the  point 
(or  possibly  one  of  the  points)  where  the  final  value  FMIN  of 
f^pp  was  found. 

BUN  is  the  final  value  of  the  best  current  minimum  function  value 
£OPT‘ 

NFEV  is  the  (output)  total  number  of  function  evaluations  (includ¬ 
ing  those  used  for  the  computation  of  derivatives,  and  for 
the  rejected  time -integration  steps). 

IOUT  is  the  (output)  indicator  of  the  stopping  conditions  as  follows: 
If  IOUT  =  -99  a  fatal  error  was  detected  when  performing  some  preliminary 
checking  of  the  input  data,  and  the  algorithm  was  not  even  started;  otherwise 
the  algorithm  was  started,  and  the  value  of  IOUT  is  the  final  value  of  the 
of  the  parameter  ISTOPT  (an  output  indicator  of  the  output  subroutine 
PTRIAL,  described  in  sect.  4.5.2.). 

Success  is  claimed  by  the  algorithm  it  IOUT  >0,  i.e.  if  at  least 
one  of  the  trials  stopped  with  a  positive  value  of  the  trial  stopping  indi¬ 
cator  ISTOP  (described  in  sect.  4.5.2)  and  no  lower  value  for  fQpy  was 
found  in  the  following  trials. 

4.3.  Some  Guidelines  for  the  Choice  of  the  Input  Parameters. 

Proper  operation  of  the  package  should  be  almost  independent  of 
IRAND,  KPBR0  (and  X0) .  The  performance  of  the  package  should  not  be  too 
sensitive  to  H,  EPS,  DX,  since  these  are  initial  values  of  variables 
which  are  adaptively  controlled  by  the  program. 

The  following  parameters  are  expected  to  have  little  effect  on  the 
performance,  as  long  as  they  belong  to  wide  "insensitivity"  bounds: 
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XRMIN,  XRMAX  are  input  N-vectors  defining  an  admissible  region  for  the 
x -values,  within  which  the  function  values  can  be  safely  com¬ 
puted  (see  [1],  sect.  3.2.11,  where  XRMIN ( I) ,  XRMAX(I)  are 
called  R*MIN,  R^) . 

i  i 

KPASCA  is  the  (input)  minimum  number  of  observation  periods,  before 
the  scaling  procedures  are  activated  (K  ). 

u  pclSCcl 

IRAND  is  a  control  (input)  index  for  the  initialization  of  the 
random  number  generator: 

if  IRAND  >  0  the  generator  is  initialized  before  starting 
the  trial  Kt  with  seed  IRAND  +  K^-l; 

if  IRAND  <  0  the  generator  is  initialized  (with  seed  0)  only 
at  the  first  call  of  SICMA. 

INHP  is  used  to  control  the  number  NHP  ("duration")  of  time  integra¬ 
tion  steps  for  observation  period  as  follows: 
if  INHP  =  1,  NHP  =  1  +  [log2(Kp)]  ,  ("short"  duration) 
if  INHP  =  2,  NHP  =  ]  ("medium"  duration) 

if  INHP  =  3,  NHP  =  Kp  ("long"  duration), 
where  [x]  is  the  greatest  integer  not  greater  than  x. 

IPRINT  is  an  input  control  index  used  to  control  the  amount  of  printed 
output  by  controlling  the  calls  to  the  user-supplied  output  sub¬ 
routines  PTSEG  (end-of-segment  output),  PTRIAL  (end-of-trial  out¬ 
put),  and  PTKSUC  (end-of-trial  output  related  to  the  count  of 
successful  trials),  described  in  sect.  4.5.2. 
if  IPRINT  <  0  no  call  to  the  print  subroutines 
if  IPRINT  =  0  call  only  PTRIAL  and  PTKSUC 
if  IPRINT  >  0  all  the  print  subroutines  are  called. 


to  a  default  value  (NTRAJ  =  7) ,  and  if  the  input  value  is 
outside  the  interval  (3,20)  NTRAJ  is  set  to  the  nearest 
extreme  value) . 

ISEGBR,  KPBR0,  INKPBR  are  the  parameters  1^,  KpQ,  Mp  which  determine 
which  one  of  the  simultaneous  trajectories  is  to  be  branched 
(see  [1],  sect.  3.2.6).  (Note  however  that  if  one  of  the  in¬ 
put  values  is  zero,  the  corresponding  variable  is  set  to  a 
default  value:  ISEGBR  =  (l+NTRAJ)/2,  (FORTRAN  integer  divi¬ 
sion)  ,  INKPBR  =  10,  KPBR0  =  3;  if  the  input  value  for  ISEGBR 
is  outside  the  interval  (1, NTRAJ),  ISEBGR  is  set  to  the  nearest 
extreme  value;  and  if  KPBR0  has  a  value  not  inside  the  interval 
(1, INKPBR),  it  is  assigned  the  same  value  modulo  INKPBR) . 

NPMIN  is  the  (input)  minimum  duration  of  a  trial,  i.e.  the  minimum 

number  of  observation  periods  before  checking  the  trial  stopping 
condition. 

NPMAX0  is  the  (input)  initial  value  (i.e.  for  the  first  trial)  for 
the  maximum  duration  of  a  trial,  i.e.  for  the  maximum  accept¬ 
able  number  NPMAX  of  observation  periods  in  a  trial  (Np^^)  • 
INPMAX  is  the  (input)  increment  for  NPMAX,  when  NPMAX  is  varied  from 


one  trial  to  the  following  one. 

NSUC  is  the  (input)  number  of  successful  trials  (with  the  same  final 
value  fQpr>  see  sect.  2)  after  which  the  computation  is 
stopped  (Nsuc) . 

NTRIAL  is  the  (input)  maximum  allowed  number  of  trials,  after  which 


the  computation  is  stopped  (N 


TRIAL ^ - 


TOLREL  and  TOLABS  are  the  (input)  relative  and  absolute  tolerances  for 
stopping  a  single  trial  (TDrj  ,  t.nc,  see  [1],  sect.  3.2.8). 
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N,  X0,  H,  EPS,  DX, 

NT RAJ,  ISEGBR,  KPBR0,  INKPBR, 

NPMIN ,  NPMAX0,  INPMAX, 

NSUC ,  NTRIAL,  TOLREL,  TOLABS,  XRMIN,  XRMAX 
KPASCA,  IRAND,  INHP,  IPRINT 

SIGMA  returns  to  the  calling  program  the  output  parameters 
NTRAJ,  ISEGBR,  KPBR0,  INKPBR, 

XMIN,  FMIN,  NFEV,  IOUT 

The  call  parameters  are  described  in  the  next  section. 

We  note  that  the  SIGMA  package  gives  the  user  the  possibility  of 
obtaining  —  during  algorithm  evolution  —  the  values  of  a  nuirber  of 
other  parameters  by  means  of  the  output  subroutine  (to  be  supplied  by 
the  user)  which  are  described  in  sect.  4.5.2.  The  parameters  are 
KP,  NF,  XOPT,  FOPT 

XPFMIN,  FPFMIN,  FPFMAX,  FT FMIN,  FTFMAX,  FTFOPT 
ISTOP,  ISTOPT,  KSUC 
and  are  described  in  sect.  4.5.2. 

4.2.  Description  of  the  parameters  of  the  call  statement  for  SIGMA. 

N  is  the  problem  dimension  (number  of  coordinates  of  a  point  x) 

X0  is  an  N-vector  containing  the  initial  values  of  the  x-variables 
H  is  the  initial  value  of  the  time  integration  steplength. 

EPS  is  the  initial  value  of  the  noise  coefficient 

DX  initial  value  of  the  magnitude  of  the  discretization  increment 
(Ax)  for  computing  the  finite-differences  derivatives. 

NTRAJ  is  the  number  of  simultaneous  trajectory  segments  (^RAJ^ • 
(Note  however  that  if  the  input  value  is  zero,  NTRAJ  is  set 


In  order  to  use  the  package  the  user  must  provide: 

a)  a  driver  program  which  calls  the  principal  subroutine  SIGMA, 

b)  a  set  of  four  auxiliary  subprograms  (to  compute  the  function 
f(x)  and  to  output  the  results) . 

The  CALL  statement  for  SIGMA  is  described  in  sect.  4.1,  the  para¬ 
meters  of  the  CALL  statement  are  described  in  sect.  4.2.  Some  guidelines 
for  the  choice  of  the  values  of  the  input  parameters  are  given  in  sect. 
4.3.  A  sample  driver  subroutine  (SIGNlAl)  which  calls  SIGMA  is  described 
in  sect.  4.4:  such  a  subroutine  assigns  default  values  to  a  nuirber  of 
input  parameters  to  SIGMA:  it  has  therefore  a  considerably  lower  number 
of  input  parameters,  and  can  be  used  as  an  easy-to-use  driver  for  the 
average  user.  The  user-supplied  subprograms  are  described  in  sect.  4.5. 

4.1.  Call  to  SIGMA 

The  call  statement  is 

CALL  SIGMA  (N,  X0,  H,  EPS,  DX, 

NT  RAJ,  ISEG13R,  KPBR0,  INKPBR , 

NPMIN ,  NPMAX0,  INPMAX, 

NSUC,  NTRIAL,  TOLREL,  TOLABS,  XRMIN,  XRMAX, 

KPASCA,  IRAND,  INHP,  IPRINT, 

XMIN ,  FMIN ,  NFEV,  IOITT) 

The  program  calling  SIGMA  must  set  the  input  call  parameters 
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(standard  gaussian,  standard  Cauchy  ([1],  sect.  3.2.7),  uniform  in  (-1,1) 
or  (0,1))  by  calling  UNIFRN. 

UNIFRN  generates  an  element  of  a  sequence  of  independent  pseudo¬ 
random  numbers  uniformly  distributed  in  kC  ,1) ,  by  calling  ALKNUT  and 
performing  a  further  (nonlinear)  randomization. 

ALKNUT  generates  an  element  of  a  sequence  of  independent  pseudo¬ 
random  numbers  (algorithm  of  Mitchell  and  Moore,  modified  as  suggested 
by  Brent,  see  ref.  [3]). 

GAUSRV  generates  an  element  of  a  sequence  of  independent  pseudo¬ 
random  N-vectors,  having  an  N-dimensional  standard  gaussian  probability 
distribution,  by  means  of  a  rejection  method,  and  based  on  uniformly 
distributed  (-1,1)  pseudo-random  numbers  obtained  by  calling  CHAOS. 

UNITRV  generates  an  element  of  a  sequence  of  independent  pseudo- 
random  N-vectors  uniformly  distributed  on  the  unit  sphere  in  R  . 


updates  a  number  of  parameters  (using  ITOLCH  and  RCLOPT) 

checks  the  algorithm-stopping  criteria 

possibly  performs  end-of-trial  outputs  by  calling  PTSEG,  PTRIAL, 

and  PTKSUC  (see  4.5.2) 

The  subroutine  STOOPT  and  RCLOPT  respectively  "store"  and  "recall" 
the  current  values  of  the  best  minimum  FOPT  and  of  the  corresponding 
minimi zer  XOPT. 

d)  Subprograms  for  rescaling  the  variables:  INISCA,  NOSCA,  SEGSCA, 
VARSCA,  CUMSCA,  ACTSCA,  MOVSCA,  UPDSCA,  EIGSCA  ([1],  sect.  3.2.12). 

INISCA  initializes  the  common  area  /SCALE/  for  the  scaling  data. 

NOSCA  deactivates  the  rescaling. 

SEGSCA  selects  the  trajectory  which  must  be  rescaled. 

VARSCA  computes  the  rescaled  variables  Ax  +  b. 

CUMSCA  stores  cumulated  statistical  data  on  the  ill -conditioning 
of  f  (Ax  +  b)  . 

ACTSCA  activates  the  rescaling. 

MOVSCA  moves  the  scaling  data  from  the  first  to  the  second  con¬ 
tinuation  of  a  branched  trajectory, 

UPDSCA  updates  the  scaling  matrix  A  and  vector  b  by  calling 
EIGSCA  and  VARSCA. 

EIGSCA  computes  the  largest  eigenvalue  of  a  matrix  used  for  rescal¬ 
ing,  starting  from  randomly  chosen  estimates  (obtained  by  calling  UNITRV) 
of  the  corresponding  eigenvector. 

e)  Subprograms  for  pseudo-random  number  generation:  CHAOS,  UNIFRN, 
ALKNUT,  GAUSRV,  UNITRV. 

CHAOS  generates  an  element  of  a  sequence  of  independent  pseudo  random 
numbers,  each  one  having  one  out  of  four  possible  probability  distributions 


4.0.  Storage  Requirements 


The  SICMA  package  contains  a  total  of  about  1900  statements  (inc  lav¬ 
ing  some  "DO  comment  lines).  Ilus  amounts  on  the  ASCII  FORTRAN  compiler 
(.with  opt  imitation  option!  of  the  l  INI  \ 'AC  FXEC  cS  operating  system  to  a  stor¬ 
age  requirement  of  about  U'OO  (So-bit)  words  for  the  instructions,  about 
3500  words  for  the  data,  and  about  14,000  words  for  the  COMMON  area.  The 
requirement  for  the  array  dimensions  are  4N  50-bit  words. 

4.7.  Example 

Let  N  =  2,  x  =  (x.,x-,)*,  and  consider  the  six-humps  camel  func- 

1  0  J  ■>  4  7 

tion  f(x)  =  —  x,  -  2.1  x.  +  4x~  +  x.x-,  +  4x,  -  4x11  which  has  four  non- 
—  o  1  1  112  2  2 

T 

global  minima,  and  two  global  minima  at  x  ~  i  [-0.089842,  0.71266)  where 

f  ~  -1.031O3.  The  sample  program  listed  in  fig.  1,  which  uses  the  easy- 

to-use  driver  SIGMA1,  was  run  on  a  UNI VAC  1100/82  computer  with  EXECS 

operating  system  (level  58R5)  and  .ASCII  FORTRAN  compiler  (version  10R1A) , 

T 

starting  from  x,f  =  (0,0)  and  with  NSUC  =  3. 

The  program  claimed  success  (I0UT  =  1)  stopping  correctly  at  one  of 
the  global  minimiters,  using  19660  function  evaluation.  The  printout  shov' 
that  if  N(.U(-  had  been  equal  to  1  (resp.  2)  ,  the  minimum  would  have  been 
found  with  only  2097  (resp.  8545)  function  evaluations. 
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VM».  P  °  0  r  fi  •  M  (  S  A  v  P  L  f  v  E  R  f  I  0  N  ) 

CALLS  S  I  G  M  A  VI*  TH£  PRIVFR  SUBROUTINE  SIG"A1 

L  0  U  B  L  E  B  R  E  C  I  S  I  C  N  XCtA^IN.^IN 

C  I  M  F  N  E  I  0  N  xC(r  ),X*IV(?) 

TEST  PROBLEM  CATA 

PRCSlE*  gimensicn 
N  =  2 

imt:al  POINT 

xc«l>  =  C-.0  0 

xCO  =  C.DC 

GET  I  »•  PUT  PARAMETERS 
LSlC  =  ’ 

IPRIN T  =  0 

CALL  OFIVER  SUBROUTINE  S  I  G  "  A  1 

CALL  SIGMA1(NfXC»NSUC,IBRlNT,XMIN,FriN,NFFV,IObT) 

S  T  C  p 
en: 


:CLcLr  PRECISION  FUNCTION  FUNCT  <N,  > 


C  COMPUTES  The  VALUE  AT  X  0*  TME  Slx-Wl^p  CAMEL  FUNCTION 
C 

:0UrLF  PRECIS  ICS  X  ,  X  X  f  Y  Y 
,  I  v;  "  N  0  I  0  \  X  (  N  ) 
xx  =  nM.nt) 

YY  =  x  (  ? ) *x ( z ) 

FUNCT  =  ((XX/3.PC-2.1rC>*YX+<,.DfI)*xx*v<1>*xC2) 

’  ♦i.,'"*(YY-1.Cr)*TY 

R  e  T  U  c  N 
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af IN, S  ACM/A  .F 1LESIGMA.TPF J.f ILEsIGMA 
FTn  10R1A  C2/l2>B5-22:02<at) 

1.  subroutine  si6mau».,xo  ,nswc  ,iprint  ,  xrin,  fm  in,n  f*  v ,  iout  ) 

2.  £ 

».  C  SIGMA1  IS  A  'DRIVER'  SUBROUTINE  WHICH  SIMPLv  CALLS  THE  PRINCIPAL 

A.  C  SUBROUTINE  SIGN*  AFTER  HAVING  ASSIGNED  DEFAULT  VALUES  TO  A  NUMBER 

5.  C  Of  INPUT  PARAMETERS  OF  SIGMA  ,  AND  MAS  THEREFORE  A  CONSIDERABLE 

6.  C  LOWER  NUMBER  OF  INPUT  PARAMETERS. 

7.  £  IT  CAN  BE  USER  AS  A  SIMPLE  EXAMPLE  Of  MOM  TO  CALL  SIGMA  ,  BUT 

8.  C  ALSO  AS  AN  EAST-TO-USfc  DRINfR  FOR  THE  AVERAGE  USER.  WHICH  MAX  FIND 

9.  C  IT  EASIER  TO  CALL  S16MA1  IN SO E  A  D  OF  SJGMA  .  THUS  AVOIDING  TH  I 

10.  C  TROUBLE  OF  ASSIGNING  A  VALUE  TO  ALL  THE  INPUT  PARAMfT  ERG  OS  SI  CMA  . 

11.  C  ALL  THE  PARAMETERS  IN  THE  DEFINITION  OF  SIGMA*  HAVE  THE  SAME  REA- 

12.  C  N1NG  AS  IN  StlGMA  . 

13.  C 

14.  C  THE  USER  OF  si  0**1  MUST  ONLT  GIVE  VaLUeS  TO  f HE  INPUT  PARAMETERS 

15.  C  N,  *0,  N  StlC  ,  I  PRINT 

16.  C  AND  OBTAINS  ON  OUTPUT  THE  SANE  OUTPUT  PARAMETERS  OJF  SIGMA 

17.  C  XM1N.  EMIN,  NFEN,  IOUI 

18.  C 

19.  C  WE  RECALL  HERE  THE  MEANXN6  Of  THE  ABOVE  PARAMETERS 

20.  C 

21.  C  N  IS  THE  PROSE. GM  DIMENSION  (NUMBER  OF  VARIABLE  s> 

22.  C  XO  IS  AN  N-VeCMOR  CONTAINING  THE  INITIAL'  VALUES  OT  THE 

23*  C  X -VARIABLE  S 

24.  C  HSUC  IS  IHE  NUMBER  OF  SUCCESSFUL  TRIALS  (WITH  THE  s*HE  FImAl 

25.  C  VALUE  FOPT  I  AFTER  WHICH  THE  COMPUTATION  IG  STOPPED. 

26.  C  IPR1NT  IS  AN  INDEX  USED  TO  CONTROL  THE  AMOUNT  OF  PRINTED  OUTPUT 

27.  C  BT  CONTROLLING  THE  CALLS  10  THE  USER-SUPPLIED  OUTPUT  SUE- 

28.  C  ROUTINES  PTSEG  4END-0F- SEGMENT  OUTPUT),  PT RIAL  (END  - 

29.  C  0F-TR1AL  OUTPUT),  AND  PTKSUC  ( END-OF -TRI At  OUTPUT  RELATED 

30.  C  TO  THE  COUNT  Of  SUCCESSFUL  TRIALS),  WHICH  ACE  DESCRIBED 

31.  C  BELOW. 

32.  C  1PR1NT.LT. 0  NO  CALL  TO  THE  OUTPUT  SUBROUTINES 

33.  C  JPRINT. (Q .0  CALL  ONLT  PTRIAL  AND  PTKSUC 

34.  C  I PR1 NT.GT . 0  CALL  ALL  OUTPUT  SUBROUTINES. 

35.  C  XNIN  IS  AN  N-VeCTBR  CONTAINING  THE  COORDINATES  OF  THE  POINT 

36.  C  (OR  P0SS1BLT  ONE  OT  THE  POINTS)  WHERE  THE  FINAL  NALNE  FM  IN 

37.  C  OF  FOPT  WAS  FOUND. 

38.  C  FM IN  IS  THE  FINAL  WALUE  OF  THE  BEST  CURRENT  H1NIMUH  FUNCTION 

39.  C  VALUE  FOPT. 

40.  C  NFEV  IS  THE  TOTAL  NUMBER  Of  FUNCTION  EVALUATION  (INCLUDING 

41.  C  THOSE  USED  FOR  TH£  COMPUTATION  Of  DERIVATIVES,  AND  FDR 

42.  £  THE  REtfECTEO  (TIME -INTEGRA  1 1  ON  STEPS). 

43.  £  10UT  IS  IHE  INDICATOR  OF  THE  STOPPING  CONDITIONS',  AS  FOLLOWS 

44.  C  If  I  OUT  «  -99  A  NATAL  ERROR  WAS  DETECTED  WHEN  PERfDR- 

45.  C  MING  SOME  MRELJMINARV  CHECKING  OF  IHE  INPUT  DATA,  AND 

46.  C  THE  ALGORITHM  WAS  NOT  EVEN  STARTED 

47.  C  OTHERWISE  TWE  ALGORITHM  WAS  STARTED,  AND  TH*  VALUE  Of 

48.  C  10UT  IS  THE  FINAL  VALUE  OF  THE  INTERNAL  PARAMETER  1STCPT 

49.  C  (AN  OUTPUT  INDICATOR  OF  THE  U SE R-SUPP LIE D  SUBROUTINE 

50.  C  PTRIAL  ). 

51.  C  SUCCESS  IS  CLAIMED  BV  NNE  ALGORITHM  IF  IOUI  .CT.  0, 

52.  c  i .1.*  if  at  least  one  of  the  trials  stopped  uniform.)  at  the 

53.  C  LEVEL  OF  THE  CURRENT  FOPT. 

54.  C 

55.  DOUBLE  PRECISION  XQ,XMJN,FH1N 


1 


1 

1 

1 

f 


S  6. 

57. 

58. 

59. 

60. 

61. 

6?.  C 
6?. 

66. 

65. 

66. 

67. 

66. 

69. 

70. 

71. 

7?. 

75. 

74. 

75. 

76. 

77. 

78. 

79. 

60. 

81  . 

8?. 

65.  1 

84.  C 

e«;. 

86. 

87. 

88. 

89. 

9fi. 

91.  C 
9?. 

93. 


DOUBLE  precision  dx.eps, m, tolabs .iolrel 

DOUBLE  PRECISION  VAN  AX  ,  VRJtl  N  ,X  RNAX  ,XRM  IN 
DIMENSION  XOEN)  ,XM4N<Ni) 

DIMENSION  XRHIN (10Q) .XRNAXElOO) 

DATA  VRH1N.VRMAX  7-1.D4t1.D4/ 

DATA  MTRILO/50/ 

H  a  I.O-JO 

EPS  «  1.00 
ox  *  i.d-9 
1R  AND  *  0 
NT  RAJ  a  0 
IS  E  GBR  >  0 
INKPBR  «  0 
KPBRQ  a  o 
NPMIN  *  10 
NPHAXfl  «  100 
INPMAX  «  50 

NTRIAL  a  M AX 0  (N  TR14.0  « 5 •  NSUC ) 

TOLREL  «  1.0-3 
TOLABS  >  1.0-6 
KPASCA  ■  10 

IMN.GT.5>KPASCA  ■  300 

IN  HP  «  f 

DO  1  IX  a  1,N 

■  RHINE  IX) *VRNIN 
XRHAXE1X) aVRNAX 
CONTINUE 

CALL  SICNA  E  N*  X0-,  H,  EPS  #  0>. 

1  NTRAJ.  1 SjfiBR,  KPBRQ,  INKPBR, 

?  NPMIN .  NPMAXO,  INPMAX, 

3  NSUC,  NTR4AL,  fOLREL,  TOLABS,  XRHIN,  XRMAX , 

6  KPASCA,  IRINO,  INMP,  1PRINT, 

5  XMIN,  HUN,  NEEV,  I  OUT  > 

RETURN 

ENO 


94. 

95. 

96. 

97. 

98. 

99. 
100. 
101  . 
10?. 

103. 

104. 


c 

c 

c 

c 

c 


SUBROUTINE  SIGMA  E 

1 

2 

3 

4 

5 


N,  no,  H,  EPS,  ox, 

NTRAJ,  ISEGBR,  KPBRQ,  INKPBR, 

NPMIN,  NPRAXO,  INPMAX, 

NSUC,  NTRIAL,  TOLRJL,  TOLABS,  XRHIN,  XPHA X, 
KPASCA,  IRANO,  INMP,  IPRINT, 

XMIN,  EMIN,  N  E  E  V ,  IOUT  ) 


THE  SUBROUTINE  SIGMA  1$  THE 
S16MA,  mNICH  ATTEMPTS  TO  E INO 
FUNCTION  MX)  »  I  (  XT',  .  .  .  ,XN) 
THE  ALfcOAlTHM  AND  ThE  PACKAGE 


PRINCIPAL  SUBROUTINE  OR  TNE  PACKAGE 
a  global  hinirizea  oe  a  real  valu  id 

0E  N  REAL  VARIABLES  X1,...,XN. 
ARE  DESCR1BL0  IN  OE  TAIL  IN  (ME  TV  ( 


PAPERS  PUELI SHE  6  IN  THE  SANE  ISSUE  0»  THE  A.C.M.  TRANSACTIONS  OR 
NAT  HE  HAT  1  CAL  S0F1VARL.,  BOflH  BT 

F.  ALUFF1-PFHT1NI,  v.  parisi,  F.  Z1RILLI. 

(1)  A  GLOBAL  MINIMIZATION  ALGORITHM  USING  STOCHASTIC  C I T  f  ERE  NT  )A  L 
EQUATIONS 

(2)  ALGORITHM  SIGMA.  A  SilOCHASTI  C-1NTE  GR  AT  10  N  6LOBAL  MINIMIZATION 
ALGORITHM. 

THE  SOFTWARE  IMPLEMENTATION  AND  ITS  USAGE  ARE  DESCRIBED  IN  (2). 
METHOD 

A  6L0BAL  MINIMIZES  Of  F(X>  IS  SOUGHT  B*  MONITORING  THE  VALUES  OF 
F  ALONG  TRAJECTORIES  GENERATED  By  A  SylrABLE  C  S  ToC**A  ST  |  C  >  *ISc*F- 
T I Z  AT  ION  OF  A  FIRST-ORDER  STOCHASTIC  DIFFERENTIAL  EQUATION  INSPIRED 
BT  STATISTICAL  MECHANICS.  STARTING  FROM  AN  1NUUAL  POINT  XO  , 

X  IS  UPDATED  B«  THE  (STOCHASTIC)  DISCRETIZATION  STEP 
X  «  X  ♦  DX.t  *  6X2 

WHERE  6X1  *  -  M  *  GAM  (FIRST  HALF-STEP) 

6X2  »  EPS  •  SORT (HO  •  U  (SEC0H6  HALF -STEP* 

And  H  IS  THE  TIME-INTEGRATION  STEPLENGTN. 

6AM/N  IS  COM  pU  TE  6  AS  A  F IN  IT E -ftl f F CR |N Cf  APPROXIMATION  TO  THE 
DIRECTIONAL  DERIVATIVE  OF  F  AL0N6  AN  I sO TROplCALLV  RANDOM 
DIRECTION, 

EPS  IS  A  POSITIVE  'NOISE'  COEFFICIENT,  AND 

U  IS  A  RANDOM  SAMPLE  FROM  AM  H— DIMENSION AL  GAUSSIAN  01 STR1BUTI <N . 
WE  CONSIDER  THE  SIMULTANEOUS  EVOLUTION  OF  A  GIVEN  FIXED  NUMBER 
NIRAi  OF  TRAJECTORIES  DURIN6  AN  OBSERVATION  PERIOD  IN  WHICH  FO K 
EACH  TRAJECTORY  EPS  IS  FIXED  HH1LE  H  AND  THE  SPATIAL  DISCRETI¬ 
ZATION  INCREMENT  DX  FOR  COMPUTING  6AM  ARE  AUTOMATICALLY 
ADJUSTED  BT  THE  ALGORITHM. 

AFTER  EVERY  OBSERVATION  PERIOD  ONE  OF  TNE  TRAJECTORIES  IS  DMCA  SO  ED 
ALL  OTHER  TRAJECTORIES  CONTINUE  UNPERTURBED,  AMD  ONE  OF  THEM  IS  SE¬ 
LECTED  FOR  BRANCHING,  I  .f  .  GENERATING  ALSO  A  SfCONO  PERTURBED  CINTI 
NU AT  1  ON ,  NITH  DIFFERENT  STARTING  EPS  AND  DX  (AND  THE  SAME 

'past  history'  of  the  f irst ) . 

THE  SET  OF  SIMULTANEOUS  TRAJECTORIES  IS  CONSIDCRFO  A  SINGLE  TRIAL, 
AND  THE  COMPLETE  ALGORITHM  IS  A  SET  OF  REPEATED  TRIALS. 

A  TRIAL  IS  STOPPED,  AT  THE  END  OF  AN  OBSERVATION  PERTOD,  AND  AT  IfR 
HAVING  DISCARDED  THE  HORS*  TRAJECTORY ,  IF  ALL  THE  FINAL  VALUES  CF 
F  FOR  THE  REMAINING  TRAJECTORIES  ARE  ERUAL  (WITHIN  NUMERICAL  T C- 
IERANCCS.  AND  POSSIBLY  AT  DIFFERENT  POINTS  X)  TO  TMI1R  MINIMUM 
VALUE  FTFMIN  ('UNIFORM  STOP  AT  THE  LEVEL  FT  EMIN  'J. 

a*  uniform  stop  is  considered  successful  only  if  the  final  valu  i 

FTFMIN  IS  (NUMER1CALLT)  EQUAL  TO  THE  CURRENT  BEST  MINIMUM  FOP T 
FOUND  SO  FAR  FROM  ALGORITHM  START. 

A  TRIAL  IS  ALSO  ANTHA-Y  STOPPED  (UNSUCCESSFULLY)  IF  A  GIVEN  NAxI  RUM 
NUMBER  NPMAX  OF  OBS  SR VAJ ION  PERIODS  HAS  ELAPSED. 

TRIALS  ARE  REPEATED  WITH  DIFFERENT  OPERATING  CONDITIONS  (.INITIAL 
POINT,  MAX  I  RIAL  LENGTH  NPMAX  ,  SEED  OF  NOISE  GENERATOR,  POLIC  ) 

for  choosing  the  starting  eps  for  the  perturbed  continuation, 

AND  TRIAL-START  VALUE  OF  CPS  >. 

THE  ALGORITHM  IS  STOPPeO,  AT  THE  END  OF  A  TRIAL,  IF  A  GIVEN  NUMBER 
NSUC  OF  UNIFORM  STOPS  AT  THE  CURRENT  FOPT  LEVEL  MAS  BEEN  REACHED 
OR  ANYWAY  IF  A  GIVEN  MAXIMUM  HUMBER  NT R I AL  OF  TRIALS  NAS  BEEN 
REACHED. 

SUCCESS  IS  CLAIMED  IE  AT  LEAST  ONE  UNIFORM  STOP  OCCURRED  AT  VME 
FINAL  VALUE  OF  FOPT. 
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CALL  STATEMENT 

the  call  Statement  is 

CALL  SI6MA  <  N,  X0*,  M,  EPS,  DI  , 

NTRAJ,  ISEGBR,  KPbRO,  INKPBR, 

NPMIN',  NPNAXO,  INPMAX, 

NS  UC «  NTfflAL.  TOLREL,  TOLABS,  XRMIN,  XRMAX , 

KPA6CA,  1  RAND «  IN HP  t  IPRJNT, 

XMlN.  EMIN,  N  F  E  V  ,  I  OUT  > 

CALL  PARAMElEaS 

INPUT  PARAMETERS  ARE  THOSE  IN  LINES  1,3, 4, 5  RF  THE  CALL  STA1EMEIT, 
INPUT-OUTPUT  parameters  ARC  THOSE  IN  LINE  ?, 

OUTPUT  PARAMETERS  ARE  THOSE  IN  LINE  6. 

NOTE  THAT  A  NUMBER  0#  OTHER  <  1NT>  RNAL)  PARAMETERS  CAM  BE  OBTAIN  ID 
B»  MEANS  OF  THE  USE  R-6UPRLI  (ft  OUTPUT  SUBROUTINES  PfTSEG,  PTRIAL, 

ANd  PTXSUC,  WHICH  ARB  DESCRIBED  BELOW. 

DESCRIPTION  OF  THE  CA4.1  PARAMETERS 

n  is  the  problem  dimension  (number  of  variables) 

XO  IS  AN  N-VCC40R  CONTAINING  THE  INITIAL  VALUES  OF  THE 

X.VAH  1A8LES 

H  IS  INI  INITIAL  VALUE  Of  THE  t IME-INTE ORATION  STEPLENGTH. 

CPS  IS  THE  INITIAL  VALUE  OF  THE  NOISE  COEf/IClEMT. 

DX  IS  1HE  INITIAL  VALUE  OF  THE  MAGNITUDE  RE  THE  DISCRETIZATION 

INCREMENT  FOR  COMPUTING  THE  FINITE-DIFFERENCE  DERIVATIVES. 
NTRAA  IS  THE  NUMBER  Of  SIMULTANEOUS  TRAJECTORIES. 

tNOIE  HOWEVER  TN AT  IF  THE  INPUT  VALUE  IS  ZERO,  NTRAJ  IS 
SET  TO  A  DEFAULT  VALUE  (NTRAJ  -  7),  A  NO  IF  «NE  INPUT  VA EUi 

is  otherwise  ouiseoc  the  interval  (3.20)  miraj  is  set  tc 

THE  NEAREST  EXTREME  VALUE). 

ISEGBR,  KPBRO,  1NKPBR  DETERMINE,  AT  THE  END  OF  AN  OBSERVATION 
PERIOD,  WHICH  ONE  Of  THE  SIMULTANEOUS  RRAJECTORIES 
IS  10  BE  BRANCHED,  AS  FOLLOWS. 

BRANCHING  IS  RORMALLT  Pf R  FORMED  ON  THE  TRAUECTORT  WHICH 
OCCUPIES  THE  PLACE  ISf GBR  IN  TNE  1RAJEC10RV  SELECTION  OR¬ 
DERING,  EXCEP1  AT  (THE  END  OF)  EXCEPTIONAL  OBSERVATION 
PERIODS,  WHERE  THE  FIRST  TRAJECTORY  IN  THE  0RDERIN6  IS 
BRANCHED.  EXCEPTIONAL  BRANCHING  OCCURS  AT  THE  OBSERVATION 
PERIODS  NUMBERED  KP  >  KPBRO  ♦  J«  INKPBR,  (J  *  1,2,3,...). 

therefore  is£6br  selects  the  level  (in  the  ordering)  at 
which  normal  branching  occurs,  while  kpbro  ano  inrpb* 

SELECT  THE  FIRST  OCCURRENCE  AND  S HE  REPETITION  FREOUENC  1 
OF  THE  EXCEPTIONAL  OBSERVATION  PERIODS. 

(NOTE  HOWEVER  THAT  IF  ONE  OF  THE  INPUT  VALUES  IS  ZERO, 

THE  CORRESPONDING  VARIABLE  IS  SET  TO  A  DEFAULT  VALUE 
ISEGBR  -  1  NT ( 41 ♦NJRA J  )  7 21  ,  INKPBR  *  10,  KPBRO  =  3. 

If  THE  INPUT  VALUE  FOR  ISEGBR  IS  OT  HERN I6E  OUTSIDE  THE 
INTERVAL  (1, NTRAJ),  ISEGBR  IS  SET  TO  THE  NEAREST 
EXTREME  VALUE,  AND  IF  KPBRO  HAS  A  VALUE  NOT  INSIDE  THE 
INTERVAL  (1, INKPBR),  II  IS  ASSIGNED  THE  SAME  VALUE 
MODULO  INKPBR). 

NPMIN  IS  THE  MINIMUM  DURATION  OF  A  TRIAL,  I  .F .  THE  MINIMUM 

NUMbER  OF  OBSERVATION  PER100S  THAI  SHOULD  ELAPSE  BEMRE 
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starting  to  check  the  trial  stopping  criteria. 

IS  1H£  WAX  I  HUB  CURAT  ION  01  THE  FIRST  TRIAL,  I.E.  THE 
VALUE,  f OR  THE  FIRST  TRIAL.  OF  HA  X I  HU  H  ACCEPTABLE 
NUMBER  NPHAX  OF  OBSERVATION  PERIODS  IN  a  (RIAL. 

IS  IHE  INC  R  EH  INI  FOR  NPHAX  .  WHEN  NPHAX  U  VARIED 
FROH  ONE  TRIAL  TO  THE  FOLLOWING  ONE. 

IS  THE  NUH6ER  OF  SUCCESSFUL  TRIALS  (HUH  THE  SAKE  FINAL 
VALUE  FOPT  >  AFTER  WHICH  THE  COHPUTA  TTON  IS  STOPPED. 

AND  TOLABS  ARE  THE  RELATIVE  AND  ABSOLUTE  TOLERANCES 
FOR  STOPPING  A  S7N6LE  TRIAL. 

XRHAX  ARE  N-TECTORS  DEFINING  T Mf  AON  ISIBLf  REGION  FOR 
THE  X-VALUES.  WITHIN  WHICH  THE  FUNCTION  VALUES  CAN  BE 
SAFELT  COMPUTED. 

IS  THE  HINT  HUM  NUMBER  OF  TRAJECTORY  SEGMENTS.  THAT  SHOULD 
ELAPSE  BEFORE  THE  RESCALING  PROCEDURES  ARE  ACTIVATED. 

IS  A  CONTROL  IN D f X  fOR  THE  INITIALIZATION  QJ  THE  RANDOM 
NUMBER  GENERATOR. 

irand.gj.o  thj  Generator  is  initialized,  before  star¬ 
ting  THE  TRIAL  KI,  WITH  SEED  IRAND*KT-1 
jRAbD.lE.O  The  GENERATOR  IS  INITIALIZED  (WITH  SEED  0> 
ONLY  At  the  first  C Al L  Of  S16*A 
IS  A  CONTROL  INDEX  FOR  SELECTING  THE  NUMBER  NHP  OF  Tl RE¬ 
INTEGRATION  STePS  FOA  OBSERVATION  PERIOD  KP  (DURATION  (F 
TRIAL  KJ»)  AS  FOLLOWS  (L06  IS  BASE  2) 

1 N  HP  *  1  NHP  »  1  »  TNT (LOG (KP) )  ( 'SHORT  '  DURATION) 

I  NHP  *2  NHP  *  INT  (SORT  (KP))  (‘’MEDIUM'’  DURATION) 

1 NHP  *  3  NHp  =  Kp  ('LONG'  OURATION) 

IS  AN  INDEX  USED  (0  CONTROL  THE  AMO  (At  T  OF  MINTED  OUTPUT 
BT  CONTROLLING  THE  CALLS  TO  THE  USER-SUPPLIER  OUTPUT  SUB¬ 
ROUTINES  PTSEG  <ENO-OF-SEGHENT  OUTPUT).  PTR1AL  (CNR  - 
0F-TR1AL  OUTPUT).  AND  PTKSUC  ( EN  D— OF -OR  1 AL  OUTPUT  RELATED 
TO  THE  COUNT  Of  SUCCESSFUL  TRIALS).  WHICH  ARE  DESCRIBED 
BELOW. 

1PR1NT.LT .0  NO  CALL  TO  THE  OUTPUT  SUBROUTINES 
IPRlWa.EO.O  CALL  ONLY  PTR1 AL  AND  PTKSUC 
1PR1N3.GT.0  CALL  ALL  OUTPUT  SUBROUTINES. 

IS  AN  N-VCCTOA  CONTAINING  THE  COORDINATES  OF  THE  POINT 
(OR  POSSIBLY  ONE  Of  THE  POINTS)  WHERE  THE  FINAL  VALUE  FM IN 
Of  FOPT  WAS  FOUND. 

IS  THE  FINAL  NALUE  Of  THE  BEST  CURRENT  MINIMUM  FUNCTION 
VALUE  FOPT. 

IS  THE  TOTAL  NUMBER  OF  FUNCTION  EVALUATION  (INCLUDING 
THOSE  USED  FOR  THg  COMPUTATION  OF  DERIVATIVES,  AND  FOR 
THE  REJECTED  TIRE-INTEGRATION  STEPS). 

IS  THE  INDICATOR  OF  THE  STOPPING  CONDITIONS,  AS  FOLLOWS 
IF  10UT  *  -90  A  FATAL  ERROR  WAS  DETECTED  WHEN  PERFOR¬ 
MING  SOME  PRElilNlNAPY  CHECKING  Of  THE  INPUT  DATA,  AN  ( 

THE  ALGO RIfTHM  WAS  NOT  EVEN  STARTED 
OTHERWISE  THE  ALGORITHM  WAS  STARTED,  AND  TN E  VALUE  OF 
IOUI  IS  THE  FINAL  VALUE  OF  THE  INTERNAL  PARAMETER  ISTCPT 
(AN  OUTPUT  1NRICAT0R  OF  THE  USER-SUPPLIED  SUBROUTINE 
PTRJAL  ,  DESCRIBED  BELOW). 

SUCCESS  IS  CLAIMED  8T  THE  ALGORITHM  IF  IOUT  .61.  0, 

I.E.  IF  AT  LEAST  ONE  OF  THE  TRIALS  STOPPED  WITH  A  POSITIVE 
VALUE  Of  THE  .TRIAL  STOPPING  1  NO  1C  AT  OR  1ST0P  (AN  OUTPUT 
INDICATOR  OF  JHE  USER-SUPPLIED  SUBROUTINE  PTRjAt  • 
DESCRIBED  BELOW),  AND  NO  LOWER  VALUE  FOR  TOPT  NAS  FOUAP 


276.  t  IN  I  HE  FOLLOWING  TRIALS. 

277.  C 

277.  C  USES -SUPPLIED  SUPROGRAMS 

279.  C 

280.  C  THE  USES  MusT  PROVIDE  TME  FUNCTION  FUNCT  TO  COMPUTE  f(X), 

281.  C  AND  THE  THREE  OUTPUT  SUBROUTINE  PTSEG,  PtRIAL,  p  1K6UC  . 

287.  C  THE  CALLS  TO  THE  OUTPUT  SUBROUTINES  ARE  COMER  OLLE D  B*  IPRINT 

2  8S.  C  (  INPUT  PARAMETER  TO  SIfiMA'T. 

284.  t  A  USER  NOT  INTERESTED  IN  USING  ANT  ONE  OF  THE  OUTPUT  SUBROUTINE S 

285.  C  MUST  PROVIDE  A  OUHMV  SUBROUTINE  (WITH  RETURN  AS  THE  OMIT 

286.  C  EXECUTABLE  STATEMENT)  TO  AV010  UNRESOLVED  REFERENCES. 

?87.  C  IN  THE  FOLLOW 1N£  DESCRIPTION  ALL  NON-INTEGER  ARSUMENT  S  ARE 

2 68.  C  DOUBLE  PRECISION  (INTEGER  ARGUMENTS  ARE  INDICATED  OT  MEANS  Of  THE 

289.  C  FORTRAN  IMPLICIT  TYPE  DEFINITION  CONVENTION). 

290.  c 

291.  C  THE  FUNCTION  FUNC1 

292.  C 

293 .  C  FUNCT  MUST  RETURN  AS  IRS  VALUE  THE  VALUE  A*  X  Of  TN E  FUnC  IjDN 

294.  C  TO  BE  HINIMIl£D 

295 •  C  THE  DEFINITION  STATEMENT  IS 

296.  C  DOUBLE  PRECISION  FUNCTION  FUNCT  <M,  X) 

297.  C  WHERE 

297 •  C  N  IS  THE  ( INPUT)  DIMENSION  OF  THE  PROBLEM. 

299.  C  X  IS  THE  (INPUT)  N-VECTOR  CO NT  AIN I MB  THE  COORDINATES  OS  THE 

300.  C  POINT  X  HHER.fi  SHE  FUNCTION  IS  TO  BE  COMPUTED. 

30  T.  C 

3C2 .  C  THE  SuBROU TINE  PT3E6 

303.  C 

304.  C  PTSEfi  IS  CALLER  (fF  1PRIMS.CT.0D  AS  TNE  END  OS  EVERT  OBSER  - 

305.  C  VAT  ION  PERIOD. 

306.  C  THE  DE  F IN11I0N  STATEMENT  IS 

307.  C  SUBROUTINE  PTiSEG  (  N,  XPFMIN,  FPFM1N,  SPFMAX, 

308.  C  XP,  NF  EH.  IPRINT  > 

309.  C  WHERE 

310.  C  N  IS  TNE  (INPUT)  DIMENSION  OF  THE  PROBLEM 

311.  C  FPFM1N,  FPFMAI  ARC  RESPECTIVELT  THE  NIN1HIP1  ANO  THE  MAXIMUM 

312.  C  AMONG  THE  VALUES  OF  Ml)  OBTAINED  AS  TNE  FINAL  POINTS  OF 

313.  C  THE  TRAIECTORT  SEGMENTS  OF  THE  (JUST  ELAPSED)  OBSERVATION 

314.  C  PERIOD  XP. 

315.  C  XPFMIN  IS  AN  M— VECTOR  CONTAINING  THE  COORDINATES  Of  THE 

316.  C  (FINAL)  POINT  (RR  ROSSIBLT  ONE  OF  SHE  POtNTSO  WHERE 

317.  C  FPFM1N  WAS  OBTAINED. 

318.  C  XP  IS  THE  TOTAL  NUMBER  OF  ELAPSEr  OBSERVATION  RERIODS  DR 

319.  C  THE  CURRENT  TRIAL. 

320.  C  NF  EV  IS  fTH  E  TOTAL  NUMBER  OE  FUNCTION  EVALUATIONS  PCrFORRED 

321.  C  FROM  ALGORITHM  START. 

322.  C 

323.  C  THE  SUBROUTINE  PI  RIAL' 

324.  C 

325.  C  PTRIAL  IS  CALLED  (If  IPRINT. GE.O)  AT  fHE  END  oT  EVERT  TRIAL  . 

326.  C  THE  Of  T  IN Irt! ON  SlAHEHENf  IS 

327.  C  SUBROUTINE  PTIUAL  (  N,  XOPT,  FOPT, 

328  .  C  f TFMIN  ■  FTFMAX,  FT FOPT , 

329.  c  ISTOP,  I SSOPT »  NFEV,  KR,  IPRINT  I 

330.  C  WHERE 

331.  C  N  IS  TNE  (INPUT)  0IHCN$10N  Of  THE  PROBLEM* 

332.  C  XOPT  IS  AN  N-VECSOR  C0NT1N1NG  THE  COORDINATES  Of  THE 
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POINT  (OR  POSSIBLY  ONE  01  THE  POINTS)  WHERE  THE  CURRENT 
P IN  1  HUH  f OPT  WAS  OB  T  A  I N  EC  • 

FOPT  IS  THE  CURRENT  BEST  MIN IN  UN  VALUE  FOUND  f OR  E  IRON 
ALGORITHM  START  <  FOPT  IS  UPDATED  WHEN  EVER  A  FUNCTION 
VALUE  IS  COMPUTED). 

FTFM1N,  FTJMAX  ARE  RfSPfCVlVELY  THE  MINI  HUH  AND  THE  MAXIMUR 
AMONG  THE  VALUES  OF  F(I>  OBTAINED  AT  THE  FINAL  POINTS  OF 
THE  LAST  TRAJECTORY  SEGMENTS  OF  THE  CURRENT  TRIAL. 

FT  FOPT  IS  THE  CURRENT  FUN  I  HUH  VALUE  OF  FTFRIN  AMONG  THE 
TRIALS  WHICH  DID  NOT  STOP  FOR  REACHING  THE  MAXIRUH  ALLOVE C 
NUMBER  OF  SEGMENTS  (STOPPING  INDICATOR  ISTOP  >  0*  SEE 
BElOW).  ftfopt  IS  USED  BT  SIGMA  TO  COMPUTE.  *SUC  (IN  HIT 
PARAMETER  TO  THE  OUTPUT  SUBROUTINE  PTKSUK  ,  SEE  BELOW). 

KP  IS  THE  TOTAL  NUMBER  OF  ELAPSED  OBSERy Af ION  PERIODS  IN 
THE  CURRfNT  T-IAL. 

NFEV  IS  JHE  TOJA£  NUMBER  BF  FUNCTION  EVALUATIONS  PERFORMED 
FROM  ALGORITHM  START. 

ISTOP  IS  THE  INDICATOR  OF  THe  STOPPING  CONDITION  OF  THE  TRl*L» 
AS  FOLLOWS 
ISTOP  =  0 

THE  MAXIMUM  NUMBER  NPMAX  OF  OBSERVATION  PERIODS  nAS 
BEEN  REACHED  . 

ISTOP. NE.O 

ALL  TH£  eNO-OF- SEGMENT  VALUES  OF  F(l)  ,  (EXCEPT  FOR  T »E 
JUST  DISCARDED  SEGMENT)  ARE  CLOSE  ENOUGH  VO  THEIN  COMM CN 
MINIMUM  VALUE  FPPH1N  ,  WITH  RESPECT  VO  AN  ABSOLUTE  OR 
RELATIVE  DIE  EERBNCE  CRIVeRION.  (0  BE  CONSIDERED  NUMERI¬ 
CALLY  EQUAL. 

THE  ABSOLUTE  VALUE  AND  V HE  SIGN  OF  ISTOP  HAVE  THE 
FOLLOWING  MEAN1N6. 

THE  ABSOLUTE  VALUE  INDICATES  WN1CN  DIEfCRENCE 
CRITERION  WAS  SATISFIED 

1  RELATIVE  DIFFERENCE  CRITERION  SATISFIED 

2  ABSOLUTE  DIFFERENCE  CRITERION  SAVISFIFO 

3  BOSH  CRITERIA  SATISFIED 

THE  SI6N  OF  ISTOP  INDICATES  THE  RELATIONSHIP  BETWEEN 
THE  ENO-OF  HYRJ At  VALUE  FPFM1N  AND  THE  CURRENT 
BEST  MINIMUM  VALUE  EOPT  (WHICH  IS  UPDATED  WHEN¬ 
EVER  A  FUNCTION  VALUE  IS  COMPUVED 
ISTOP. ST .0 

FPFM1H  IS  NUMFR1CALLV  EQUAL  (W.R.T.  AT  LEAST 
ONE  OF  (THE  ABOVE  DIFFERENCE  CRIVEVIAI  TO  EO  FT 
ISTOP.  liT.O 

FPFMIH  VS  NOT  EVEN  NUBERICALLY  EQUAL  TO  FOP  1 
(AND  THEREFORE  CANNOT  BE  CONSIDERED  AS  AN 
ACCEPTABLE  GLOBAL  MINIMUM). 

1ST0PT  IS  THE  VA4.UE  OF  THF  TRIAL  STOPPING  INDICATOR  ISTOP 
CORRESPONDING  TO  THE  CCURRENT  OR  PAST)  TRIAL  WHERE  FTFOPT 
WAS  OBTAINED,  WJTH  THE  SIGN  WHICH  IS  UPDATED  ACCORDING  TO 
THE  COMPARISON  BETWEEN  FTFOPT  AND  THE  PRESENT  VALUE  OF 
FOPT  ,  AS  DESCRIBED  ABOVE. 

THF  FINAL  VALUE  Of  ISTOP  IS  RETURNED  BY  SICNA  AS  THE  VALUE 
Of  THE  OUTPUT  INDICATOR  IOUT  OF  THF  A LG  OR  I  TUN  STOPPING  CON¬ 
DITIONS  (WHENEVER  IHE  ALGORITHM  WAS  STARTED,  I0UT.NE.-V9, 

SEE  ABOVE). 

THE  SUBROUTINE  PINSUC 


390.  C 

391.  C  PTKSuC  Is  CALLEO  «NLt  AT  THE  END  OF  f VEST  SUCCESSFUL  TRIAL 

39? .  C  SUCH  THAT  AN  1MCREMENJ  OCCURRED  IN  THE  VALUE  A  SUC  OF  ThE 

393.  C  MAXIMUM  NUMBER  Of  SUCCESSFUL  TRIALS  AT  THE  SAME  (CURRENT  OR 

T9*.  C  PAST)  VALUE  OF  FORT  .  A  CALL  TO  PTRSUC  THEREFORE  PROVIDE  ! 

395.  C  THE  USER  WITH  THE  OPERJUT  ION  ALL  V  INTERESTING  INFORMATION  THAT 

396.  C  A  FINAL  SUCCESS  CLAIM  MOULD  HAVE  TAKEN  PLA  G6»  IF  NSNC  (INP  IT 

397.  C  PARAMETER  TO  SIGMA  )  HAD  BEEN  GIVEN  R  LOWER  VALUE*  E«UAL  TO 

398 .  C  THE  CURRENT  KjuC  . 

399.  C  PT K SUC  IS  CALLED  ONLT  IF  SPRINT. 6E.0  AND  K  StK.  LT.ttSUC  . 

A  00  .  C  THE  DEFINITION  S  T  AIM  £M)T  IS 

*01.  C  SUBROUJINE  PTHSUC  (  KSUC  ) 

*02-  C  WHERE  KSUC  IS  THA  INTEGER  VARIABLE  <1  .LE.  KSUC  .LE.  NSUC) 

*0  3  .  C  DEFINED  ABOVE. 

AOA.  C 

405  .  DOUBLE  PRECISION  X 0 tN , £»S ,D X ,T OLREL. TOLABS 

AC6 .  DOUBLE  PRECISION  X RM IN *XRMAX , X  MI N* FM IN 

A07.  DOUBLE  PRECISION  EPS AG *£ PSAP ,F PS C 

AO? .  DOUBLE  PRECISION  E RSMAX .EPS R * f »FOPT , FT f M AX 

Aq9.  DOUBLE  PRECISION  f IFMJN  * F  TFOPT 

*19  .  c 

All.  OOUBLE  PRECISION  X ,Ht ,DXC ,VMVT  .EPS  CO ,VMCOR  ,VCOR 

AT?.  DOUBLE  PRECISION  X RM 1 C « XRMAC ,X OP T . FO PTC 

A13.  C 

A1A.  DOUBLE  PRfCISlfiN  0 ISI, BI AS *6RA GR A. 6R A 

*15.  C 

*16.  DIMENSION  XO  tN)  *  XM  IN  (N )  .XRMIM  N>  *X  RM  AX  (  N> 

*17.  C 

*18.  COMMON  /DINCOM/  X ( TOO . 20 ) , HC (? 0) ,D XC (?0) ,V MVT ( ?0 ,1 9) , E PSCO (? () , 

A 1 9 .  T  VNCOR<20).VC0A(?0),XRNIC<T00),XRNACM0Cr>.XOPJ<100>.fOrTC  , 

A  20  .  ?  lE(?0>iISVT(  2(V*  19)  .KGEN.KTIM.NDIN'.NTRAJC  *N  1RAV  R  * 

*21.  3  lSEGBC.INKPBC.KPBROC.NCF.IEEPC.INHPC 

A??.  C 

*23.  COMMON  /SCALE?  D 1  S.1  ( 10 ,1 0 ,20>  *  BI  AS  ( 10, 20),  CRACRAOO  ,1B  4?0>  * 

A2A.  1  GRA(10.?0>.NGRA(20>.LSCA.IDSCA  .NX'.NORO 

*25.  C 

A26 .  C  DATA  FOR  THE  VARIATION  OF  NOISE  COEFFICIENT 
*27.  C 

*28.  DATA  EPSR/T.DA/,EPSAP/10.00/*EPSAS/1.03/ 

*29.  DATA  ERSM AX/1. 015/ 

*30.  C 

*31.  1FEP  «  1 

*32.  C 

*33.  C  INITIALIZE  COMMON  ARCJt  /DINCOM/ 

A  3*  •  C 

*35.  CALL  INIt(N,XO,H,ERS,DX*I*AND« F. 

*36.  1  NTRAJ , JSEGGR .ZNKPBR  *KPBRO* 1NHP  *1 FEP*  XR  MIN  *XRHA X  *I0UT) 

*37.  C 

*38.  C  CHECK  PARAMETER  VALUES 

*39.  C 

**0.  If (NPM IN. LE.O. OR.NPMAXO.LT. 0.0 R. IN PM*X.L  E. O.OR. 

4*1.  1  NSUC. LE.O.OR.N.  TRIAL. L£.0)IOUT  •  -99 

442.  IF  C10UT.ER. (-99))«ETURN 

4*3.  C 

**«.  C  INITIALIZE  VARIABLES 

4*5.  C 

4*6.  EPSC  =  ERS 


a 


**7.  NPNAX  *  NPMAJtO 

**8.  1STOPT  r  0 

44«.  ISTOP  *  0 

450.  I  C  COM  =  (NTR1AL  AMTH1AL'«4  >/5 

*51.  Nf  E  V  =  0 

45?.  N  T  £  S  =  NSUC 

455.  1 CTS  *  NSUC-1 

45*.  FTFOPT  *  F 

*55 .  C 

*56.  C  5TART  SERIES  Of  TRIALS 

*57.  C 

*58.  60  30  1C  *  1.NTRIAL 

*59.  C 

*6 P.  C  SET  INITIALIZATION  IN  6  EX  FOR  NOISE  GENERATOR 

*61  .  C 

*62.  IS  =  0 

463.  1H1RAND.GT.0US  -  18ANDMC-1 

46*.  C 

465.  C  INITIALIZE  iRJAL 

*66.  C 

*67.  IK  IC.Gt«1«AnO*’1C  .Lt  •  lCCON>  c*LL  R  £l  N 1  T<  N,XO  .EPS  C  .  1  S  »  f  .  1  F  E  F) 

468.  I  f  (  1  C  .  6.1  .ICC  ON  )C  ALL  •  £  INI  T  (  k,  XM  IN  ,£P  S  C,  »s  »  »  Opl  »  1  Ft  P  ) 

*69 .  C 

*70.  FTFMIN  x  F 

471.  FTFMAX  «  f 

*7?.  Nf  E  V  -  NFEVaI 

*73.  C 

*7*.  C  PRINT  INITIAL  CONDITIONS  OF  TRIAL 

*75.  C 

*76.  If  UPRINT  .6T  .0)ICALL  PT  S  f  6  (N  ,X  0,  FT  HUN  ,  F  TEN  A  *  ,0,  Nf  E  V  ) 

*77.  C 

*78.  C 

*79.  C  DEACTIVATE  SCALING 

*80.  C 

*81.  If  (XPAsCA.GT.NPNAX.Ct.N.LE.DCALL  NOS  CA 

*82.  C 

*83.  C  INITIALIZE  COMMON  AREA  ‘/SCALE/ 

*8*.  C 

*85.  IMKPAsCA.LE.NPRAX.AND.N.GT.TZCALL  INIS  CAlN.NTRAJi 

*  E  6  .  C 

*87.  C  PERFORM  A  TRIAL 

*88.  C 

*89.  CALL  TRlAL<NtNRNlk*NMMAX»KPASCA'TOLREL» T0LA8S, 

*90.  1  IP  R  IN  T  (  XMlN't  F  T/  M  IN  ( 

*91.  1  FlfNAX.NFEV.KP, ISTOP) 

*92.  C 

*93.  C 

*9*.  c  EVALUATE  past  trial  And  prepare  next  trial 
*95.  C 

*96.  c 

*97.  C  SET  TRIAL  DURATION 

*98.  C 

*99.  IfEISTOp.EO.  0  )  NPM  AX  -  NPNAXUNPNAX 

500 .  C 

501.  C  tESET  CURRENT  NUMBER  «f  successes  required  before  STOPPING 

502.  C  COMPUTE  INDICATOR  Of  TRIAL  STOPPING  CONDITIONS 

503.  C  UPDATE  BEST  CURRENT  VALUES  OF  fRIAL  STOPPING  INDICATOR  AND 
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5C*.  C  Of  JUNCTION  MX)  AT  TRIAL  STOP 

505.  C 

506.  IfMf  if*IN.6T.f  lfOPT.OR.lSTOP.£8.0).AN&  .1 SIOF5J  .  NE  .0  >GO  TO  10 

50?.  If <1T0LCH< FT FOPl.f If *1N, JOLREL.TOLABs). EW.0>NTE S  *  NSUC 

508 .  C 

509.  f  T  f  OPT  =  I T I  HIM 

510.  ISTOPI  -  ISTOP 

511.  10  CONTINUE 

51?.  ISTOPT  »  I  AB  S  ( I  ST OPT ) 

515.  CALL  RCL0PT(N,XJ1IN,  FOPT) 

‘1*.  I  f ( 1 TOLCH (f T FOPT ,f OBT , TO L R  E  L  ,  T  0  L  A  BS ) . £0  .0) ISXQP T  ■  -ISTOPI 

515.  If < ITOL CH CFT fHIN.f OPT , TOLRE L, TOLABS ) .EO  .0)1  STOP  *  -ISTOP 

516.  C 

51?.  C  ENO-Of-IRIAL  PRINT  OEM 

5 1  8  .  C 

519.  If (1PR INT.ee .0) 

520.  1  CALL  PTRIAL  *  N,  XOPT,  FOPT, 

521.  2  fTFMIN,  fTfNAX,  FTFOPT, 

522  .  5  ISTOP,  ISTOPT,  N  f  E  V,  X P,  I  PRINT  ) 

523  .  C 

52*.  C  UPDATE  INITIAL  VALUE  «f  NOrSE  COEFFICIENT  f OR  NEXT  TRIAL 

525  .  C 

526.  If  (IstOp. EO.OIIPSC  *  EPSC/EPSR 

527.  If <ISI0P.6T.0)tRSC  »  EPSC«EPSAG 

528.  If (ISTOP. LT.0.ANO.iC.LE.ICC0N)€PSC  *  EPSC«EP6APi 

529.  If C1ST0P.LT. 0. AND. 1C. 6T.ICC0N)EPSC  x  EPSC/EPS* 

5  30.  C 

531.  C  UPDATE  0PERATIN6  CONDITIONS  FOR  S  ELEC  TIN6  I IN  THE  NEXT  TRIAL) 

532  .  C  THE  STARTING  VALUE  Of  THE  NOISE  COEFFICIENT  OF  THE  NEW  TRAJECTO  IT 

533.  C  AFTER  BRANCHING 

53*.  C 

535  .  If  (ISTOP. EO. 0)  IFeP  »  1 

5  56  .  If  (ISTOP. NE  .OlfEP  »  2 

537.  C 

538  .  C  UPDATE,  PRINT,  AND  CHECK  'TRIAL  SJOPPING  CONDITIONS 

5  39.  C 

5*0.  If (ISTOP. GT.O. AND. ISTOPT. G7.0)NTES  «  NT ES-1 

5*1.  IMNTfS.LE  .0  .OR  .ISTOPT  .LE.O  .OR.  IS  TOP.  LE  .O.OR.NTES.GS.lCTS  .OR. 

5*2.  1  1PR1NT.LT. 0)  GO  TO  20 

5*3.  KSUC  «  NSUC-ICTS 

5**.  CALL  PTKSUC(KSUX) 

5*5.  ICTS  *  NTES-1 

5*6.  20  CONTINUE 

5*7.  1FCNTES .LE.0.ANR.I5T0PT.GT.0. AND. ISTOP. GT. 0)GD  TO  *0 

5*8.  C 

5*9.  C  CONSTRAIN  NOISE  COEFFICIENT  WITHIN  BOUNDS 

550.  C 

551.  f PS  C  x  DHINl (EPSC.f PSHAX) 

552.  IMfPSC  .LE  .Q.D0>£PSC  =■  T  .00 

553.  30  CONTINUE 

55*.  C  f  N  D  OF  SERIES  OF  TRIALS 

5  55  .  C 

556.  *C  CONTINUE 

557.  C 

558.  I  INDICATOR  Of  STOPPING  ConO|TIONS 
559  .  C 

560.  IOU?  *  ISTOPT 


i  0 


CALL  OERCEN<NOIM,Xi.FV,OX»W,OFOXl 


206. 

20  7.  C 

2  0  A .  C  TB,  AGAIN  T«E  FIRST  HAlF-SIEP 

209.  DO  AO  1C  =  1  ,ND1M 

210.  XP<IC)  *  X(  lC)-H*W(lOsDFDX«DBLE(ElOATfNDIM>« 

211.  AO  CONTINUE 

212.  F  =  fUNCTC (NOIM.XP) 

2 1 1 .  FVS  *  FV*0XSDA8S<0EDXV-0»DX> 

?  I  A  .  C 

215.  C 

216.  C  UPDATE  STEPLEN6TM  H  AnD  ACCEPT  OR  REJECT  THE  HALT-STEP 

2  1  2  .  CALL  NEUMKTlM.FVS'.f  ,H,  JE.1EC) 

2l«.  C 

219.  C  UPDATE  CUMULATED  PASJ  SCALING  DATA 

220.  1 f C 1 E C.6E.  1) CALL  C UN  SC  A <ND I M  .U  ,D FC X ) 

221.  1F(IEC.6E.1)G0  TO  10 

222.  DX  =  0  X  *  R  D  X 

223-  C 

22 A.  C  FIRST  HALF  —  $TEp  ACCEPTED 

223.  SO  CONTINUE 
72p  .  C 

227.  c  update  cumulated  past  scaling  data 
22s.  CALL  CUMSCACNOIH,N',OFOX> 

229.  FS  *  FV*0X«DA8SFDFDX) 

23p  .  IF  <  JTOLCHf  f  S  ,  F  W  ,  IOLRI  .iTOLABS),  E«  .0  )DX  P  DX/RCD 

231.  IF< ITOLCUC »S ,FV , IOLR A.J0LA8S ) . GT .0>DX  *  DX«RCD 

732.  EPSR  *  DSORT(H)«EPS 

73*.  C 

2  3  A ,  C  1 A  X  F  A  SAMPLE  INCREMENT  OF  TME  WIENER  PROCESS 
2  3  S .  CALL  GAUSRVCNOIM.U) 

236  .  C 

237.  C  TFT  THE  SECOND  HALF-STiP 

23s .  00  60  1C  *  1  .NO  1 M 

239.  XP<IC)  »  XPUC)  AEPSRAWCIO 

2  A  0  •  6P  CONTINUE 

2  A 1  .  F  *  FUNCTO(NDIM.XP') 

2  A  2  .  C 

2 A  3 .  C  ACCFPT  OR  REJECT  THE  COMPLETE  STEP 

2  A  A .  IT  < F-F V.IE.EPS *fP.S*S»F )  GO  TO  70 

2  A  3 .  H  *  M*  MR 

2A6.  IE  =  I  E  ♦  1 

2 A  7 .  IF  (H.GT.HMINS)  GO  TO  20 

2AP  .  C 

2A 9.  c  STEP  ACCEPTED 

7  s P .  70  CONTINUE 

2 S 1 •  DO  80  1C  =  T  .NO  I M 

25?.  X(IC)  =  XPUC) 

255.  80  CONTINUE 

2  S  A  ,  OX  a  DM  IN  1 CDX.DXMAJO 

255.  DX  =  DMAXl (DX.DXM1N) 

256  .  C 

25  7.  R  f  TURN 

25*.  END 
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iu«.  c  computed 

150.  C  -  CALLS  T  HI  SUBROUTINE  DErFoR  F  OR  DERCEn  )  10  COMPUTE  THE  FORWARD— 

151.  C  (OR  CENTRAL-)  D  if  F  p  hf  NC  E  S  DIRECTIONAL  DERIVATIVE  6AM/* 

115?.  C  -  CALLS  THE  SUBROUTINE  N  E  UN  TO  ACCEPT  OR  REUECT  THE  FIRST  HA  IF - 

IIS'?.  C  STEP  AND  OBTAIN  AN  UPDATED  VALUE  FOR  H 

1154.  C  -  CALLS  THE  SUBROUTINE  AUMSCA  TO  UPDATE  THE  CUMULATED  SCAL1NC  DATA 

155.  C  -  UPDATES  THE  SPATIAL  DISCRETIZATION  INCRMENT  DX  BASED  ON  THE 

1 1 56 .  C  RESULTS  0#  CALLING  THE  FUNCTION  ITOLCH 

1157.  C  -  CALLS  THE  SUBROUTINE  6AUSRV  TO  PERFORM  THE  SECOND  HALF-STEF. 

1 1  5  P  •  C 

159.  DOUBLE  precision  x.h.eps.dx.f 

!  1 6g  •  DOUBLE  PRECISION  D IDX , D F OK V , D X MA X , DXMJ N 

1161.  DOUBLE  PRECISION  £PSR  .  F  S  ,  F  V  ,  F  V  S,  MM  IN  S’,  HR  ,H  S 

116?.  DOUBLE  PRECISION  BCD .AD  X , S T F ,T 0L AB S , TRLR A* TOLR 1 

163.  DOUeLE  PRECISION  U  ,XP 

1164.  DOUBLE  PRECISION  FUNCTO 

1165.  DIMENSION  X(NDIM) 

1166.  DIMENSION  N(100>  ,XP(100) 

167.  DATA  RDX/1.D-4/ 

168.  DATA  DXM1N/1 .D— 35/ 

169.  DATA  DXMAX/1 .03/ 

1170.  DATA  HR/1.D-1/ 

1171.  DATA  HM IN S 71 .0-3  0/ 

1 7? .  DATA  STF  /-100.D0/ 

173.  DATA  BCD/?. DO/ 

174.  DATA  T0LR1/1.D-5/ 

175.  DATA  TOLRA/1 .0-11/ 

176.  DATA  TOLABS/0.D0/ 

1177.  C 

178.  IEC  »  0 

1179.  IV  •=  F 

18(1.  TO  CONTINUE 

181.  20  CONTINUE 

18?.  C 

185.  C  take  A  RANDOM  DIrECTJON  f  0*  ThE  DIRECTIONAL  DEUVATJMf 

184.  CALL  UNIIRV(MOIM.M) 

185.  C 

186.  C  COMPUTE  FOR  WAR  D-D IF  F  ERENCf  DERIVATIVE 

187.  CALL  D(RF0R(ND1M  .X^FV.DX  «  W  ,  D  F DX) 

188.  C 

189.  C  TRT  THE  FIRST  HALF-STeR 

190.  DO  30  IC  *  1.NDIM 

191.  XP(IC)  *  X(1C)-M*NCIC>*DFDX*DBLE(FL0AT(MDIM)) 

192.  3r  CONTINUE 

193.  MS  *  H 

194.  F  -  FUNCTflENDIM  ,XP») 

195.  FVS  *  F V«DX*DABS <D»DX) 

196.  C 

197.  C  UPDATE  STEPLCNGTH  H  AND  ACCEPT  OR  REJECT  THE  NALF-STEP 

198.  CALL  NEWHOCTIH'FVS’.F.MME.IEC) 

199.  IF(IEC.LE.0)£O  TO  50 

?0C.  IE  =  IE-1 

201.  IEC  *  IEC-1 

?0?.  H  ■  MS 

203.  DFDXV  *  D  F  DX 

?0  4  •  C 

205.  C  COMPUTE  CENiRAL-DIFFERLnCES  DERIVATIVE 


HOC. 

1  WMCOR  <20  )  .  V  COR  <2o  >  .XRN1NU  00>,XRNAX<  10  0>,XOP'TMOO>  ,FOPT 

1101  . 

?  1E(?0>,1SVT<20»19),RGEN,KT  1M tU D I N , NT RA J.N T RA JR , 

110?. 

3  ISEGbR  ,inkpbr,*pbrc»ncf ,1FEP ,lnhp 

1 1 0  3  . 

C 

1104. 

*  T 1 M  =  K  T I M* 1 

110«. 

C 

1106. 

C 

LOOP  ON  THE  SIMULTANEOUS  TRAJECTORY  SEGMENTS 

lie?. 

DO  30  1 0  =  1  tNT  RAJ 

110«. 

C 

1109. 

C 

INFORM  THE  SCALING  SU0BR06RAnS  (VIA  THE  COMMON  AREA  /SCALE?) 

hit’. 

£ 

THAT  SCALING  OPERATIONS  ARE  TO  BE  PERFORMED  ON  sE6MEnT  ID  . 

mi. 

CALL  SEGSCA(IO) 

in?. 

F  *  VCOH(IO) 

iii*. 

C 

1114. 

C 

PERFORM  A  T 1ME-INTE6RAT10N  STEP  ON  SEGMENT  ID  . 

1115. 

A  A  x  XT1M 

1116. 

NA  s  ND1M 

1117. 

CO  10  IX  x  1 ,NX 

1118. 

XID(IX)  x  IUI,U) 

1119. 

10 

CONTINUE 

I1»n. 

HID  =  H  < I D ) 

1121. 

£  PS  I 0  x  fRS(ID) 

112?. 

DXID  x  DX(ID) 

11?*. 

1 1 1 D  x  IE  (ID) 

1124. 

C 

1125. 

CALL  SS IE  PCX  A ,NX ,X ID .HID »£PSI D, OX  ID  ,  I  El  D»F) 

1126  . 

C 

1127. 

00  20  IX  x  1 ,sx 

112*  . 

XCIX.ID)  x  X  ID (I X) 

1129. 

?o 

CONTINUE 

113  0. 

H(ID)  x  HID 

1111. 

EPS ( 1 D  )  «  EPSID 

111?. 

0  X ( ID)  x  DXID 

11  51. 

1E(1D)  «  IE10 

1134. 

VCOR(ID)  >  F 

1115. 

VNCOR(ID)  x  DMIN1 (VNCOR(ID)  ,f) 

1136. 

IF(  IK.ES.  I)VMCOR(ID)  P  f 

1137. 

ifcktim.fo.t  ) I E -( I D >  -  0 

113*. 

30 

CON  T  INUE 

1139. 

c 

1140. 

RETURN 

1141  • 

END 

114?.  SUBS  OUT  INE  S  S  TE  P  UTI  N  ,  SO  I  M  ,  X  ,H  ,f  PS  ,0  X',  IE  •  F  > 

HAT.  C 

1144.  C  THE  BASIC  TIME-  IN1EGR  ATION  S»fP  f  OS  A  61VEN  TRAJECTORY  IS  PER  TO  FM  ED 
114  5.  C  B Y  THE  SUBROUTIME  STEP  WHICH 

1146.  C  ~  CALLS  THE  (UNCTION  EUNCTQ  TO  COMPUTE  THE  VALUE  OF  F 

1147.  C  -  CALLS  THE  SUBROUTIME  UNITRV  TO  COMPUTE  THE  RANDOM  DIReCTIOA 

114*.  C  A  (.ON  6  WHICH  THE  DIRECTIONAL  DERIVATIVE  6AM  /N  IS  TO  BE 
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1 

1051  . 

DU  *0  1DD  =  1 (N TR  A  j 

2 

1052. 

1  Ft  1  SWTllD  ,1  11)  .EQ.  1SV1  (  1DD“,  IT  1)  >NCV  =  NCV*1 

2 

105'. 

*r 

CONTINUE 

1 

ip5*  . 

50 

CONTINUE 

105;. 

DO  80  IT  *  2,NTRAjR 

1 

1056. 

111  =  IT-1 

1 

10;7  • 

NCN  =  0 

1 

1 05 P  . 

DO  70  ID  =  1.NTRAJ 

2 

1059. 

DO  60  I DD  x  1 f  NT  R  A j 

3 

1060. 

ir<lSVTIl»,lT).EO.ISWT(IDD,lT>)NCN  *  NCN* 1 

3 

1061  . 

60 

CONTINUE 

2 

1062. 

70 

CONT INUE 

1 

106!. 

If(NCA.E9.NCV)£0  TO  1lO 

1 

106*. 

NCV  =  NCN 

1 

1065  . 

80 

CONTINUE 

1066  . 

DO  90  ID  *  1.NTRAJ 

1 

1067. 

IFtlSVTtl  ,1).Nf«ISVT*IC,1))60  TO  100 

1 

106*. 

90 

CONTINUE 

1069. 

IT  =  2 

1070. 

GO  TO  1*0 

1071  . 

IOC 

CONT INUE 

10?2. 

TIC 

CONTINUE 

107». 

120 

CONTINUE 

107*. 

it  =  m*i 

1075. 

*0  13o  ID  «  1  , N  T RA'j 

1 

1076. 

VHVKID.ll)  =  DN1N1  IVMNT  (ID  ,1  T»  ,VMVT  (  ID  U  T  1  >1 

1 

1077. 

130 

CONTINUE 

1078. 

1*0 

CONTINUE 

1079. 

00  160  IIC  *  IT .NT  RA JR 

1 

ioeo. 

ITM  *  ITC-1 

1 

1081. 

DO  150  ID  x  1.N1RAJ 

2 

1082. 

WM V T  (ID. ITM)  x  VM VT (ID.1TC) 

2 

1085. 

1SVT (1 D.1TM)  *  TSVT(ID.ITC) 

2 

108*. 

150 

CONTINUE 

1 

1085  . 

160 

CONTINUE 

1 

1086. 

C 

1087. 

RETURN 

ioee . 

END 

1C89. 

1090. 

1091. 
109?. 
1097  . 
109*. 
1095  . 

1096. 

1097. 
1095. 
1099. 


SUBR0U1 IRE  STEP(IK) 

C 

C  STEP  PERFORM;  A  SINGLE  1  jMf  ~\ NT E  &R  *7  ION  STfP  FOR  EACH  ONE  OF  T  FE 
C  SIMULTANEOUS  TRAJECTORIES  BY  REPEATEDLY  CALL! N£  THE  SUBROUTINE  SSTEP 
C 

DOUBLE  PRECISION  F 

DOUBLE  PRECISION  X  ,M,OX,VMVT,FPS  .VnCOR.VCOR 
DOUBLE  PRECISION  *  AN  1 N , * RM A  X , X  OP  1 , FO PT 
DOUBLE  PRECISION  X  ID  ,I»I  D  »EPS  I  D  ,DX  1  D 
DIMENSION  X1DC100) 

COMMON  /DINCOM/  X  E  .100 .  20  >  . H  «  20  >  ,  OX  <  ?0  >  ,  VMV  T <  2 0,  19  >  ,  EP S  <2 Q  )  , 
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1007. 

1004. 

1005. 

1006. 
ICO/. 
1004. 
1P09. 
1C10. 
1011  . 
101?. 
101*. 
1014  . 
1015. 
l0l<s. 

1017. 

1018. 

1019. 

1020. 
lO«?1  * 
102?  . 
102?. 
1C24  . 
1025. 


1026  « 

SUBROUTINE  compas 

1027. 

C 

102  E  . 

C 

COPRAS  takes  care  of  The  storage  of  pas.  history  rata,  discarding 

1029. 

c 

ALL  DATA  NOT  NEEDED  8V  THE  ONLY  USER  OF  SUCH  DATA,  TN E  FUNCTION 

1C30  • 

c 

1PREC  . 

1031  . 

c 

103?. 

DOUBLE  PRECISION  X  ,H  ,01  ,  VPVT , E  PS  * V NCOR  » V  CO  R 

1033. 

DOUBLE  PRECISION  X HP IN , XRNAX ,X OPT , FOPT 

1034  . 

COUPON  /D1NC0P2  X(100,20),M<2D ),DX(?0) ,VNVT(20,a9D,EPSC20)V 

1035  . 

1  VP  COR  (20),  VC  OR  (20)  ,X  RHINE  100  ),XRPAX(10M«XOPT<  100)  ,  FOPT  , 

1016. 

2  1EE20)  ,ISVT (20,19) .XGEN.KT IP, N DIP, NT  BA J.NTRAUR , 

1037. 

3  lSE6BR,INKPBRtKPBR0>,NCF  ,1F  EP.INHP 

1038  . 

c 

1039. 

IT  T  =  1 

1040. 

00  70  IT  >  2  .NTRAJR 

1041  . 

ITT  *  IT-1 

104?. 

DO  IQ  ID  «  1  .NT  RAJ 

1043. 

lF(lSVI(ID,ll).NE.ISVTfID,IT1>)G0  TO  20 

1044  . 

10 

CONTINUE 

1045  . 

60  TO  120 

1046. 

20 

CONTINUE 

1C47. 

30 

CONTINUE 

1 04  R  . 

I T 1  i  1 

1049. 

NCV  *  0 

1050. 

DO  5Q  ID  -  1  ,  NIB  A J 

INTEGER  (UNCTION  IPRECEC1D1 ,102) 

C 

C  IPRECE  OETERPINES  THE  PRECEDENCE  RELATION  BETWEEN  a*0  f r AJ£C TO  f  1  E S 
C  BASED  ON  THEIR  CURRiNI  VALUE  OF  EPS 
C 

DOUBLE  PRECISION  X ,H ,0 X , VPV T , F PS , V PCOR , VCO R 
DOUBLE  PRECISION  X RP IN ,X RHAX ,X OPT . f OPT 

COPftON  SDINCQP/  XtlOO',  ?0)  ,H<20  )  ,  DX  (20)  .VNV  Tt20  „19)  .EPS  (20)  , 

1  VHCOR ( 20 ) ,VCOR *20 > ,X RUIN  Cl  00 ) . XRNAX E 10  0>, XOFT E 100 > »FOPT  , 

?  l E (20)  .1 SVI (20  ,  19  > .KGEN.KT 1H.NDIH.NTRA J.NTRAJR , 

3  IS  E  6bR  ,INKPBR,KPBRO,NCF ,1?  EP.INHP 
1PRECE  *  0 

1FEK&EN.6T.ISE6BR«JN*PBR)60  TO  IQ 
1( (EPS(  ID2I.LT.EPS *ID1))IPReCe  =  I  01 
IF  (EPS(ID?).OT.  EPS.(1D1))1PRECE  *  ID? 

RETURN 

C 

10  C0NT1NUE 

If (EPS* ID?)»LT.ePSCID1 >)IPRECE  »  ID? 
I((CPS(It2).£T.EPS*lD1))lPRECE  *  I D1 
C 

RETURN 

END 


20 


a*  ru  FV 


961  . 

*c 

CONTINUE 

96?. 

sc 

CONT INUf 

963. 

60 

CONTINUE 

96*  . 

IMlk. £Q.2>60  10  30 

965. 

C 

966. 

C 

RE  TURN 

THE  INDICES  of  THE  SEGMENTS 

WHICH  IN  THE  0RDERIN6 

967. 

C 

OCCUPT 

THE  FIRST,  1H£  LAST,  AND  A 

SUITABLE  MEDIUM  LEVEL  POSITION 

968. 

c 

969. 

IP 

r  IORDfl) 

970. 

1U 

x  I  OR  D ( NT  RAJ ) 

971. 

1M 

=  I ORD  <  IS  E6BR  I 

97?. 

c 

978. 

RETURN 

97*. 

END 

k' 

,"i 


% 


975. 

976. 

977. 
9  78  . 
979. 
98C  . 
981. 
98?. 
983. 
98*. 

985. 

986. 

987. 

988. 
969. 
990. 
991  . 
99?. 
993  . 
99*  . 
995  . 

996. 

997. 
998  . 
999. 

1000. 
1001  . 
100?. 


IN  T  £  68  ii  FUNCTION  I  RRE  C  (191*10?) 

C 

C  IPREC  DETERMINES  THE  PRECEDENCE  RELATION  BETWEEN  f«0  TRAJECTORIES 
C  BASED  ON  THE  PAST  M1S10RV  DATA 
C 

DOUBLE  PRECISION  VMl »VM? 

DOUBLE  PRECISION  X-,H  ,0X  ,  VHVI  ,E  PS  ,V  MCOA  ,VCO  R 
DOUBLE  PRECISION  X  RM IN  tXRMAX . X  OPT , EOPR 

COMMON  /D1NCOM/  X <  LOO  .  20 > • H ( 20 > * DX C ?0» . VMV Tl 20 • I®’  . E PS C20 >  , 

1  VMCOR(20).VC0RC?0) ,XRMlNt1DO>*XRMAXl1DO>,XOPT< 100)  ,EOPT, 

?  IE  <20  (ISVT<20,19>,K6EN»KT1M.NDIM.NTRA  J.NTRAJR  , 

3  IS  E  6BR tlMKPBR  t KPBRO  tNt (  .1FEP.1NHP 

C 

VM 1  x  VMVT <1 D1 ,NTR AJR) 

VM2  *  VMVT  <102  .NTRJkJR) 

DO  10  111  =  1.NTRAJR 

IT  x  14KTRAJR-UT 

If<ISVT<IDl,lT)  .Efi.JSVT(lD2.1T))G0  TO  ?C 
VMl  •  DM1NKVH1  .VMVTUD1  ,it>> 

VN?  *  DMIM1<VM2  #VMV1 (1D2,1T)) 

1C  CONTINUE 

?0  CONTINUE 
1PREC  >  0 

IMVM2.L1  .VMD1PREC  ■  1 D 2 
IMVM2.61  . VM1)IPRE  I  x  ioi 
C 

RETURN 

END 


•J 


1 


I 
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! 


. 3>L' •  '■■'vim-'.'.-i.' ^.4.AiKL: 


912 


SU6«0UHH(  ORDE R (I R.IM , IU> 

ORDER  COMPARES  THE  TRAJECTORIES  FROM  THE  POINT  Oy  VIEW  0«  PAST 
HISTORY  TOY  C  ALL  IN  6  THE  FUNCTION  IPREC  )  AND  FROM  JHE  POINT  Of  VIEn 
Of  THEIR  CURRENT  VALUE  OR  CPS  f  BY  C  ALL-IN6  THE  FUNCTION  1PRECE) 

AND  PROVIDES  -THE  TRAJECTORY  ORDERING  NEEDED  FOR  S  ELJ.C  TING  THE  TRA¬ 
JECTORY  WHICH  IS  TO  8  E  BRANCHED. 

DOUBLE  PfifClSlCN  X,H,0I,VMV7,EPS,VMC0R,VC0t 
DOUBLE  PRECISION  * RM I N  ,  Y RN A  * . X  OP T , FO PT 

COMMON  /DINCOMJ  X< 100,20)  ,H(?0 ),DK <?3)  , VMV T< 2 0 , J 9) , £ PS ( 20 ) , 

T  VMCOfi  (20)  ,VC0R  E20)  , X RM1N ( t 00 ) , *RMA*( 10 0) , XOPT ( 100 >  t FOPT , 

2  IE  (20)  .1  S  VT  (  2Q'«  1 9  )  .KGEN.AT  IM  ,  N  D  I  M',  NT  RA  J  ,NT  R  A  JR  , 

3  IS  EGfaR .lNAPBR.APbRO.NCC ,1# LP  ,INHP 
DIMENSION  10RD ( 20 ) 

DATA  KP/O/ 

Ifc  =  0 

ASSIGN  INITIAL  ORDERING 

10  CONTINUE 

DO  20  1  -  1.NTRAJ 

I  OR  D ( I )  *  I 

2P  CONTINUE 

SORT  TRAJECTORIES  ... 

30  CONTINUE 
1R  *  IRAl 

DO  60  1  >  l.NTRAJR 

II  *  1«1 

DO  SO  J  -  II  ,NT  RAJ 
A  1  =  lORC(I) 

C2  *  IORC(U) 

...  ACCORDING  TO  PAST  HISTORY  ... 

2F(IR.NE.2)KP  -  IPRECCK1 »K  2) 

1 F ( K  P.l 0.0 .AND . I R . EO. 1 ) G 0  TO  10 

...  OR  ACC0R0IN6  TO  NOISE  tE*EL 


ir(IR.£0.2)KP  -  IPREt £ (A  1 .A2 ) 
1 F(AP. £0.0)60  TO  40 
AM  *  A  1  ♦A  2  —A  P 
I  OR  0(1)  ^  AP 
IORD(J)  -  AM 
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T*fF» 


n^l^^"PMPWI 11 


i 


I 


I 


I 


855. 

856. 

857. 

858. 

859. 
86C. 
86)  • 
862. 

863. 

864. 
863. 
866. 

867. 

868. 
869. 
87?. 

871. 

872. 

873. 
8  74. 
875  . 

876. 

877. 

878. 
8  79. 
880. 
881. 
882. 
88^. 

884. 

885. 

886. 

887. 

888. 

889. 

890. 
891  . 

892. 

893. 

894. 

895. 

896. 

897. 

898. 

899. 

900. 

901. 

902. 
90J. 
904. 
905  . 

906. 

907. 

908. 

909. 

910  . 

911  . 


C 

C 

c 


c 

c 

c 

c 

c 

c 

c 

c 

c 


UPDATE  PAST  HISTORY  OAIA 

DO  10  16  =  1  ,NTRAJ 

VMVT (ID.NTRAJR)  =  VRCORdO) 

1SV1  (ID.NTRAJR)  *  16 
10  CONTINUE 

OBTAIN  trajectory -SELECTION  ordering 

CALL  ORDER  (I  p,l*,l  u) 

DECIDE  WHICH  TRAJECTORY  jS  TO  BE  BRANCHED 
1  f (ROD (KGEN.INk PbR) .Eft.KPBRO) IM  »  IP 
PFREORH  BRANCHING 


c 

c 

c 

c 

c 

c 

c 

c 

c 


DO  20  1C  *  1  ,NC  I  „ 

XflC.lU)  *  X ( IC  ,IH> 

20  CONTINUE 

H(1U)  =  H ( IN  ) 

1ECIU)  •  1  ft  1 H ) 

DO  30  IT  «  1 , NT R AJR 

ISVT(IU.IT)  «  ISVTCIH.IT) 
VRVT(1U,1T>  «  VMVT  f 1H  »1T ) 
3r  CONTINUE 

EPS(IU)  =  EPS(JH) 

DI(IU)  «  DX<1H) 

VCOR(IU)  *  VC  OR (IN) 

DO  40  ID  -  1 tNT  RAJ 

VNCOR(ID)  *  VC04U1D1 
40  CONTINUE 


UPDATE  PAST •H I STORT-DA 1A  MATRICES 

CALL  COMPAS 

UPDATE  SCALING  DATA 

CALL  "OvsCACIu.Ih) 

UPDATE  NOISE  COEFFICIENT  VALUES 

IE  (EPS (lu).LE. 0.60)  Go  TO  SO 
IE(1EEP.E0.2) 

1  E  PS ( 1U  )  «  EP£(1U)*EAC6**(CHA0S (O)-EFAC J 
IF(IEEP.ES.i) 

1  EPS ( 1U  )  ■  f AtG««(DMlN1<DLEPRX, 

1  DL0  6tC(f  PS  <1U>7«  (CHAOS  (>1)>E  F  A  C )  « 6 L F  AC  L9  > 

EPS ( 1U )  =  DR  INI (EPS(IU).EPSMAXJ 
50  CONTINUE 

UPDATE  MAGNITUDE  VOF  SPATIAL  D I  S  CR  ET  1 2  AT  ION  INCREMENT 

DX(IU)  s  OX(lU)«Df AC«*CHA0S(0> 

RETURN 


^4 

m 
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I 


kOa. 
?07. 
8  08. 
p09. 

sin. 
811. 
ST2  . 
«1  3. 
8  1  4  • 
81'  . 
8  1  6  . 

817. 

818. 
819. 
870. 
8  2 1  . 
82?  . 
823. 
824  . 
82'. 


1  INTlSNGL  (DL06IDBLE  If  L0ATEK6EN)  )«.5pn)/  DL06  (2  .0  0  )  )  )  *1 
If < JNHP.iO.?)NK6EN  «  !NT<SN6L(DSQRT(DBLE  (FLOAT  IK G £ N ) ) « . 5 DO > )  ) 
If ( INMP.tO. 3>NKGEN  1  X  GEN 
C 

c  perform  THf  weguired  number  of  Integration  steps 

C  (fOR  ALL  TRAJECTORIES) 

C 

00  TO  IK  *  1  , HAGEN 
C 

C  PfRfORN  A  SINGLE  INTEGRATION  STEP 
C  1 f  OR  ALL  TRAJECTORIES) 

C 

CALL  STLPI1K) 

10  CONTINUE 

C 

C  MANAGE  THp  TRAjfCTORT  BRANCHING  PROCESS 
C 

CALL  8  R  AS  I 

RETURN 

END 


8?6  • 
827. 

82P  • 
829. 
8  3  n  • 
831. 
83?. 
835. 

834. 

835. 

836. 

837. 

838. 

839. 
8*0  • 
841. 
84?. 

84  *  . 
844. 

845  . 

846  . 
8.47. 
848  . 

849. 

850. 
851. 
85?. 

85  *. 
854  . 


SUBROUTINE  BRAS1 
C 

C  BRASI  PERFORMS  THE  SELECTION  PROCESS  FOR  THE  TRAJECTORIES 
C  PRASI  -  UPDATES  THE  OATA  ABOUT  THE  PAST  TRAJECTORIES 
C  -  ASKS  FOR  THE  TRAJECTORY-SELECTION  ORDERING  BT  CALLING  THE 

C  SUBROUTINE  ORDER 

t  -  DISCARDS  ONE  OF  .'THE  TRAJECTORIES 

C  -  PERFORMS  BRANCHING  ON  ONE  OF  THE  REMAINING  TRAJECTORIES 

C  -  MOVES  THE  0 A 1 A  OF  THE  UNPERTURBED  CONTINUATION 

C  TO  THE  POSITION  OF  THE  PERTURBED  CONTINUATION 

C  -  CALLS  THE  SUBROUTINE  COMPAS  TO  EXAMINE  DATA  ABOUT  PAST 

C  HISJOHT  Of  THE  TRAJECTORIES  AND  DISCARD  IRRILEVANT  DATA 

C 

DOUBLE  PRECISION  D AAC . DLEPMX  ,D LF AC L 
DOUBLE  PRECISION  £ EAC , EPSMAX ,F AC G 
DOUBLE  PRECISION  CHAOS 

DOUBLE  PRECISION  X ,M , » X , VMV T , E PS . V MC OR  , V CO R 
DOUBLE  PRECISION  X RM IN .XRMAX ,X OPT , FOPY 

COMMON  /DINCOH/  X(  100.20'>,H(20),DX(2Gi,VHVT(20.19>  ,EPS(?Q>, 

1  VHCOR  (20)  ,V  COR  (201.IRM1NC  100>.  XRMAX  (10  M.XOPTI  TOO)  ,f  OPT, 

?  IE<?0).ISVT(20»19>.KGEn.KT IMiNDJM.NTRA J.NTR A JR  , 

3  IS  E GBR .1NKPBR .KPBRO.NCF , I F  EP , I NHP 
C 

OATA  FACG/10.DQ/ 

OATA  EFAC/.5D3/ 

DATA  0EAC/1.03/ 

DATA  EPSMAX?  1.015/ 

DATA  6LFACL  /O . 30 1 02999 5 66398 1 1940 0/ 

DATA  DLEPMX  /2 5 .00/ 


6 


757. 

C 

758  • 

CALL  PERIOD 

759. 

C 

760. 

C 

EXTRACT  AND  REsCALE  SOME  F:jN*L 

761  • 

C 

76?. 

FM  =  y COR ( 1) 

763. 

FM  AX  =  VCO  R (  1  > 

76*. 

1FM  *  1 

765. 

DO  30  ID  *  2.NTRAJ 

766. 

FMA  X  =  DM A XI (FNAX,VCOR( 

767. 

If (VCOR (1 D>.6E.GM)G0  TO 

768  . 

FM  *  V  C  OR (ID) 

769. 

I  FM  ■  ID 

770. 

20 

CONTINUE 

771. 

30 

CONTINUE 

77?. 

DO  40  1C  =  1  , N  0  I M 

773. 

XMIN(IC)  •  X  (  1C‘,  I  f  M) 

77*. 

*0 

CONTINUE 

775. 

f  M  IN  :  FM 

776. 

NCEF  >  NCF 

777. 

CALL  SeGSCA(IFM) 

778. 

CALL  VARSC A(NX ,XM1N) 

779. 

C 

780. 

RETURN 

781. 

END 

78?.  SUBROUTINE  PERIOD 

78*.  C 

78*.  C  PERIOD  IS  CALLEO  BY  SUBROUTINE  GENEVA  TO  PERFORM  THE  GENERATION 

785.  C  OF  THE  TRAJECTORY  SEGMENTS. 

786.  c  period  -  computes  the  duration  of  the  observation  period,  i.e.  th 

787.  C  NUMBER  NMP  Of  ACCEPTED  INTEGRATION  STEPS  IN  A  PERIOD 

78 8.  C  -  COMPUTES  ALL  TMf  SEGMENT  STEPS  BY  REPEATEDLY  CALLJN6  THE 

780.  C  SUBROUTING  STEP 

790.  C  -  PERFORMS  THft  SEGMENT  SELECTION  BY  CALLING  THE  SUBROUTINE 

79  T •  C  BRASI 

79?.  C 

792.  DOUBLE  PRECISION  *  ,H  ,DX«,  VNV  T  ,  F  PS  ,  vMCOr  ,  V  Co  R 

79*.  DOUBLE  PRECISION  X RM IN .XRMAX , X  OPT , FOPT 

79?.  COMMON  /DINCOM/  X< LOO ,200 ,H <20 > , OX <20> ,VMV TC?0 • tfPS (20> • 

796.  T  VMCOR ( 20 ),VC0R(?07,XRN1N(T00)«  XRNAX (TOO) , XOPJ< TOO) ,f OPT, 

797.  2  IE(2C>,ISVT(20,19>,KGEn»KTIm,NDIM,NTRAJ,NTR  A JR , 

798.  3  1SIGBR ,INKPBR,KPBRC,NCF,IFEP,iNHP 

799.  C 

800.  C  DETERMINE  DURATION  OF  OBSERVATION  PERIOD 

801.  C  (NUMBER  OF  TIME  INTEGRATION  STEPSY 
80?.  C 

803.  KGEN  =  KGE  N* 1 

80*.  NK  GEN  -  1 

80S.  IF  ilNHP.EQ.1  INKGCh* 


I  EV> 


70* .  C 


709. 

C 

PRINT  RESULTS  Of  OB 

710. 

c 

Til  . 

If ( IPRINt.GT 

71?. 

t 

713. 

c 

CHECK  TRIAL  ST°PPl« 

71*  . 

c 

713. 

Iff  IR.LT.HpN 

716. 

ISTOP  »  I IOL 

7l  7. 

If (1STOP.NE. 

718. 

c 

719. 

1  r 

CONTINUE 

720. 

tO 
c  - 

CONTINUE 

721. 

3fl 

CONTINUE 

722  . 

CALL  NOSCA 

723. 

c 

72*. 

RE  TURN 

725. 

END 

SERRATION  PER|Oo 

•  oK*ll  ptseg<n.xmin. f*iN«r 

*  C Qn6 iff  ONS 

1k>8o  to  10 

CM  (MAX  .fMIN.TOLREL.TOLABS) 
0>G-0  10  30 


7?6. 
727. 
728  . 
7?9. 

73*. 
731. 
73?. 
73?  • 
73*. 
733. 
736. 
757. 

738. 

739. 
7  *r. 
7*1. 
7*7. 
74  T  . 
74*. 
743  . 
7*6. 
7*7. 
7*8. 
7*9. 
730  . 
751. 
75?. 
75?. 
75*. 
75<  . 
756. 


SUBRQUT  ME  G£NEVA(NX  . X Ml  N  .  F  M  IN  .FMAX.NCEF  I 

SEME V A  PERFORMS  THE  GENERATION  AND  THE  EiN AL  PROCESS  IN*  AND 
f  ¥  A  LU  AT  ION  Of  THE  SET  Of  TRAJECTORY  SEGMENTS  CORRESPONDING  TO 
THE  CURRENT  06S£RVA II  ON  PERIOD. 

GENEVA  UPDATES  THE  S  CANING  ARRAYS  DISI  AND  BIAS  BY  CALLING 
IME  SUBROUTINES  SE6SCA  AND  UPftS CA 
GENERATES  THE  TRAJECTORY  SEGMENTS  BY  CALLIMfi  THE  SUB¬ 
ROUTINE  PERIOD 

DETERMINES  SOME  END-Of-SE 6MENT  RESULTS  ( fPf H IN .  f Pf MAX 
KPfMINT  USING  (THE  RESCALING  CAPABILITIES  Of  THE  SUB 
ROUTINES  SEGSCA  AND  VARSCAw 

DOUBLE  PRECISION  X*IN  »  f  MIN  ,  EMA  X 
DOUBLE  PRECISION  EM 

DOUBLE  PRECISION  X, H  ,0 X , VMV T PE PS ,V MCOR ,V CO R 
DOUBLE  PRECISION  X  IN  IN ,X RMAX ,X OPT, f OPT 

COMMON  /OINCOMJ  X  (  100 . 20)  ,H(  20  >  ,  DX  (2  0)  ,VMV  T1 20G 19*  *  EPS  (  ?0»  . 

1  WMcOR(2oJ,VCOR«20>,XRMIN(1OO>,  XRMAXC  l0tf>  tXOPTXlOOI.fOPT, 

?  IE  (  20  )  1 1  SVT  C20',19>  ,X6EN,KT1N,NDINI,NTRA  J.NTRAJR. 

?  IS  EGOR  »INKPBR,KPBRO«NCf .If  EP.1NHP 

DIMENSION  XMINENXI 

UPDATE  SCALING  DATA 

00  IQ  ID  *  1  .nTRAJ 
CALL  SEGSCA(IO) 

CALL  UP0S£A(NX,X(1.1S>> 

10  CONTINUE 

GENERATE  THE  SIMULTANEOUS  TRAJECTORY  SEGMENTS 


659. 

KGEN  *  0 

660. 

X  T  1 M  =  0 

66 1  . 

00  30  ID  «  1 ,NTRAJ 

1 

66?  . 

DO  10  JC  *  1.NDJM 

? 

66J  . 

X(IC.ID)  =  XC(1C> 

2 

666  . 

10 

CONTINUE 

1 

665. 

1  E ( i D)  x  o 

1 

666. 

OO  29  IT  =  1  ,  NT  HA  J  R 

2 

667. 

ISVT(]D,17)  X  1 

2 

668  • 

VMVT (1 A , 1 T )  »  f 

2 

669. 

2r 

CONTINUE 

1 

670- 

CPS(Ib)  *  £PSO«*PSV*»(ISf 6BR-ID) 

1 

671  . 

VMCOR (ID)  *  f 

1 

67?. 

VCOH(ID)  -  F 

1 

67». 

30 

CONTINUE 

676. 

RETURN 

675  . 

END 

676.  SUBROUTINE  TA  I AL  (N  ,NPM  IN  ,NPM  A*  ,K  P  A  SC  A  , 

677.  1  TOLREL.TOLABS.IPRINT.XHIN.FMIN, 

678.  ?  FMAX,NFEV,NR  f 1ST OR) 

679.  t 

680.  C  THE  SUBROUTINE  TRIAL  GENERATES  A  TRIAL',  I  .E  .  A  SET  OF  CONpLETt 

681.  C  SIMULTANEOUS  iTR  A  JE  C  TO  HI  E  S  BT  REPEATEDLY  PERFORMING 

68?.  C  A  CALL  TO  THE  SUBROUTINE  GENEVA  WHICH  GENERATES  THE  SET  OF 

68?.  C  SIMULTANEOUS  TRAJECTORY  SEGMENTS  CORRESPONDING  TO  THE  CURRENT 

686.  C  OBSERVATION  PERIOD,  AND  PERFORMS  THE  TRAUECTONY  SELECTION 

685.  C  A  (POS  S  IfaLE )  CALL  TO  THE  SUBROUTINE  PTSEG  WHICH  PERFORMS 

686.  C  END-Of-SEGMENT  OUTPUT 

687.  C  A  CHECK  OF  THE  TRIAL  SSOPPJNG  CRITERIA  (WITH  THE  AID  OF  THE 

688.  CO  FUNCTION  1TOLCM 

689.  C  A  DECISION  ABOUT  ACTIVATING  OR  DEACTIVATING  THE  SCALING  OF 

690.  C  THE  VARIABLES  (ACTIONS  PERFORMED  BT  CALLING  THE  SUBROUTINES 

691.  C  ACTSCA  AMD  NOSCA). 

69?.  C 

69  7.  DOUBLE  PRECISION  TQL RE  l«<IOlABS  ,X Ml  N,  FM1N  ,F MAX 

69*.  DIMENSION  XHIN(N) 

695.  DAYA  IRNF/7/ 

696.  C 

697.  DO  20  II  >  1 , NPMAX 

698.  C 

699.  C  ACTIVATE  SCALING 

700.  C 

701.  IF(IR.6E.KpASCA.AnD.IR.gT.NMRNF>CALL  ACTSCA 

70?.  NR  =  1R 

703.  C 

706.  C  6FNERATE  AND  EVALUATE  THE  .SIMULTANEOUS  TRAJECTORY  SEGMENTS 

705.  C  PERIOD 

706.  C 

707.  CALL  GENE VA(n,XhIN,FMIN,FMAX,NTEV> 


•  .1 


f 


610. 

ir<lSEG6R.£0.0)ISEQB«  *  <1*  NTR  A J 

611  . 

I  S  E  GBR  *  MINOd  SEGBR.NTRAJ) 

612. 

IS  E  GuR  *  A  AX  Q ( 1 S  EGBR . 1 ) 

61*. 

N2  =  ISE6HR 

614. 

1NKP0R  =  N3 

615  . 

1F(1NKPBR.EQ.0)INKRBR  *  1NKPB0 

616. 

N  3  *  INKPBR 

617. 

KP6R0  =  N4 

618. 

IF  (KPBRO.ED.Q)XPBRQ  *  XPBROO 

619. 

XPBRQ  =  MOO(KPBRQ.iNXPBR) 

620. 

N4  *  KPBRO 

621. 

ND 1M  *  NX 

622. 

NTRAJR  *  NJRAJ-1 

623. 

NCF  *  1 

624. 

F  *  F UN C T(NX.XO) 

625  . 

CALL  STOOPTENX.XQ.f) 

626  • 

DO  20  I 6  *  1  t NT  RAJ 

627. 

H  (  I D )  -  HO 

6  2  • 

DX ( ID)  *  DXO 

629. 

20  CONTINUE 

630- 

C 

631  . 

c 

INITIALIZE  REMAINING  VARIABLES 

632. 

c 

633. 

CALL  RE  INI 1<NX,X0,IPS0.1RAND»F  .1 

634  . 

c 

635  . 

RETURN 

636. 

END 

6  3  7.  SUBROUTINE  R E IN  I T < NX , X  0 ,£PSO , I RA ND , T  ,  I f E  ) 

639.  C 

639.  t  REIMT  PERFORMS  TH£  I N X T J A L I  2  A W ON  OF  ALL  TRIALS  FOLLOWING  THE 
6 AC .  C  FIRST  TRIAL,  and  PART  OF  THE  INITIALIZATION  OF  THE  FIRST  TRIAL. 
641  .  t 

642.  DOUBLE  PRECISION  XO.EPSO.F 

643.  OOUBLE  PRECISION  EPSV.G 

644.  DOUBLE  PRECISION  CHAOS 

645  .  DOUBLE  PRECISION  X ,M ,DX , VMV T ,E PS , V MCOR  ,V CO R 

646.  DOUBLE  PRECISION  X  AM  I N . X RM AX , X  OPT . FO PT 

64  7.  COMMON  /D1NCOM/  XE  ICO .  20 >  »H < 2 0 )  ,  OX  (  20)  . VMV  T<20 . 195  » EPS  < 20>  . 

648  .  t  VMC OR (20)  .  W  COR  (20  .XRM1NC1  00  )  *  XRMAXf  TO  01  »  X  OR  T4  1 00  )  .FORT  . 

649.  ?  IEE 20)  ,1 SVT (20 .19)  , K6EN.XT IM.NDTM.NTRA J.NTRAUR . 

650.  I  ISEGbR.lNKPBR'APBRO'.NCT  .IFtP.INHP 

651.  DIMENSION  XO(NX) 

652.  DATA  EPSV/I.DO/ 

653  .  C 

654.  C  INITIALIZE  RANDOM  NO  1  Si  6f Nf R A  T OR 

655.  C 

656.  G  *  CH  AO  S ( IRANO ) 

657.  C 

659  .  IFEP  *  li E 


ININ 


fopt 


561  . 

562.  C 
56?.  REIMS* 

564.  C 

565.  END 


566.  SUBROUTINE  1  NIT (NX>,XQ .NO ,EPSO, PRO. IR AND* f « NR ,N2 ,N3 ,N4 

567.  1  .  INH.  1  EE  ,  XRI 

568.  t 

569.  C  IN  IT  PERI  ORMS  THE  INITIALIZATION  Of  THE  EIRS1  TRIAL. 

570.  C  THE  PART  01  THE  IN  I TI At  1 I  AT IBN  WHICH  IS  COMMON  ALSO  TO  THE  TWIRLS 

571.  t  FOLLOWING  THE  FIRST  ONE  LS  PERFORMER  BV  CALL1M6  THE  SUBROUTINE 

572.  C  RE  INI T . 

57?.  C 

574.  ROUBLE  PfiEClslON  , h° »E P SO . pX 0. f . XR 1 . XR A 

575.  ROUBLE  PRECISION  fUNCT 

576.  DOUBLE  PRECISION  X ,H  ,0k  ,  VMVC  ,E PS ,¥ MCO» ,W CO R 

577.  ROUBLE  PRECISION  X  BN  I N ,X RMAX , X  OPT , FOPT 

578.  COMMON  /RINCON/  X  <  100 . 20 >  , H  ( 20  >  ,  DX  (2  0 >  .  V MV  T( 2 0 , 1 9 >  , E PS  ( ?0)  , 

579.  1  VHcOR(2p),VCORC2O7,XRHJNC1OO>,XRHAX<1OC0,XOP1!1Oa»,FOPT, 

580.  2  JE ( 20) ,1 SVT (20,19) ,KGEN«KT IM,ND1H,NTRA J.NTRAJR  , 

581.  ?  1Se6BR,1NKPBR,«PBR0,NCF,1»EP,INHP 

582.  DIMENSION  XO (NX )  ,XR1<MX) ,XRA(NX) 

58?.  RATA  NRHAX/1Q0/ 

584.  OATA  NTRAJM/20/ 

585.  RATA  NTRAJO/7/ 

586.  RATA  1NKPB0/10/ 

587.  RATA  KPBROO/?/ 

588  .  C 

589.  C  CHECK  PARAMETER  VALUES 

590.  C 

591.  IT  *  0 

597.  IF  (NX.6T.NPMAX.OR.NX.LT.1.0R.HO.LE.O«RO.O R.EpSO.iE.O.RO 

593.  1  .OR.OXO.LE.G.OO)  IT  *  w99 

594.  IF  (  IT  «ER  ••<”,99)  )  RETURN 

595.  C 

596.  C  INITIALIZE  SOME  VARIABLES 

597.  C 

598.  INHP  ■  INH 

599.  RO  10  IX  *  1  ,NX 

1  600*  XRMIN(IX)  =  XRI (IX) 

1  601.  YRHAX(IX)  *  XRA.(I XO 

1  602.  1C  CONTINUE 

603.  CALL  NOSCA 

604.  NTRAJ  *  N1 

605.  IF(NTRAJ.ER.0>NTRA4  *  NIRAJO 

606.  NTRAJ  =  MINO(NTRAX.NTRAUM) 

607.  NTRAJ  »  MAXOtNTRAJ-,3) 

608.  N 1  *  NTRAJ 

609.  ISE6BV  •  N2 
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SUBROUTINE  N EVH  (K  ,  FV  ,f  ,H  ,  1 E  ,1 t C) 


1259. 

1260. 
126  1. 
1262. 
1263  . 
1264. 
1265  . 
1266. 

1267. 

1268. 

1269. 

1270. 
1271. 
127?. 
1273  . 
127*. 
|  275. 

1276. 

1277. 
1278  . 
1270. 
1280. 
1281  . 
1282. 

1283. 

1284. 

1285. 

1286. 

1287. 

1288. 

1289. 

1290. 
1291  . 
1292. 
1293  . 
1294. 
1?95. 

1296. 

1297. 

1298. 

1299. 

1300. 
1301  . 


C 

C  NEVh  IS  CALLED  BH  THfc  SUBROUTINE  SSTFP  TO  DECIDE  WHETHER  TO  ACCEPT 
C  OR  REJECT  THE  FIRST  HALE-STEP,  AND  TO  PROVIDE  AN  UPDATED  VALUE  FOR  H 

c 

DOUBLE  PRECISION  FV,F,H 

DOUBLE  PRECISION  FA, Eft  ,HMAX  ,HM IN  ,R 

DIMENSION  FR(3),fA(4) 

data  FR 71 .05  DO, 2 .00  ,  lo  .DO/ 

DATA  F A/1 .00  ,1. IDO  ,2  .60,13 .00/ 

DATA  HM1N/1.D-30/ 

DATA  HMAX/1.D2S/ 

DATA  I E  CM A  X/ 50/ 

C 

1F(FV.LT.F>60  TO  20 
C 

C  STEP  ACCEPTED,  pOsSIBlT  INCREASE  ThE  STfPLeNGTH  H 
C 

R  *  F  A  (  1  J 

IF<lt«2.LT.X)R  =  F  A  ( 2  X 
IF(1E*3.LT.K  )ft  *  F  A ( 3 ) 

IFClE.EQ.O.AND.K.Gl.f )R  «  FA(4) 

H  =  H*  ft 
1C  CONTINUE 
IEC  =  0 
GO  TO  30 
C 

20  CONTINUE 
IE  =  I E  ♦! 

1 E  C  =  1  EC* 1 

1F1IEC.G1  .1ECMAXIG0  10  30 
C 

C  STEP  REJECTED,  DECREASE  H 
C 

1C  *  M INC  f  3, 1 E  C ) 

R  =  F  R  1  I  C  ) 

H  -  H/fc 
3f  CONTINUE 

M  «  DM1N1 (H,HMAX> 

H  *  ON  A  X 1 ( H , HM IN) 

C 

RETURN 

END 


1302. 
1303  . 
1304. 
1305  . 
1306. 


SUBROUTINE  D E RF OR ( LD IN  , X , F , DX , N, DF  DX > 

C  6 

C  DERF0R  COMPUTED  THE  fORWARD  F IN  I T f -D 1 F F E RN CE S  DIRECTIONAL 
C  DERIVATIVES  (CALLING  FUNCffO  ) 

C 


1 

1 

1 


130?. 
13C9. 
ISO*. 
1310. 
1311  . 
131?. 
1313. 

1  3  1 4  • 

1315. 
131ft. 
*317. 
151*. 
1  3i<». 
1320. 
1321  . 

1322. 

1323. 

1324. 

1325. 
132ft. 
1327. 
1328  . 
132«. 
133p. 

1  331  . 
1332  . 
1333. 
153ft. 

1  335. 
1336. 


DOUBLE  PRECISION  X  ,  f  ,D X  ,  W  ,D F DX 
DOUBLE  PRECISION  D XF , D X F F ,»XMA X , FN  ,S  , X X 
DOUBLE  PRECISION  F4JNCTQ 
DIMENSION  X(NDIM).U(NP1M) 

DIMENSION  XX(100> 

0414  DXFF /I. 06/ ,0X1/1.01/ 

0414  0  XHA  X i\ .0  6/ 

10  CONTINUE 
20  CONTINUE 
S  =  0.00 

00  30  IC  *  T  ,N0IN 

XX(1C)  =  X(  1C)«N(IC>«DX 
S  *  S  ♦  (  XX  (IC)-X-<1C))»»? 

30  CONTINUE 

IFES.GT.o.00160  TO  40 

DX  *  D  X  •  D  X  IF 
40  TO  20 

4  0  CONTINUE 

»N  =  FUNCTO(NDIMtXX) 

OFOX  *  ON-O/OX 
I F 1 0X.6T. DXM4XI RETURN 
IMDaBSIDFDD.CT.I  .DO)  re  turn 
I  F  (0F0XO  2  .ST.C.bO  160  TO  50 
DX  *  0  X  *0 X  F 
60  TO  10 

5  C  CONTINUE 

RETURN 

END 


1 

1 


n37. 
13  38  . 

1339. 

1340. 

1341. 

1342. 
1  343  . 
1344  . 
1  345  . 

1346. 

1347. 
1  348  . 
1  349. 
1350. 
1351  . 
1  552  . 
135  3. 

1  354  . 
1  355  . 


SUBROUTINE  DE RC EN< ID 1M  ,X , F , 0*> M, DF DX ) 

C  OERFOR  COMPUTES  THE  CENTRAL  f INI IE -0  IF F ERN CE S  DIRECTIONAL 
C  DERIVATIVES  (CALLING  FUNCTO  ) 

C 

OOUBLF  PRECISION  X  ,F , 0 X  ,  M  ,0 EDX 
DOUBLE  PRECISION  FN,FR,XX 
DOUBLE  PRECISION  FUNCT C 
DIMENSION  X(NDIM),U(NDIN) 

DIMENSION  XX (100) 

C 

»0  10  IC  »  1 ,NDIH 

XX(IC)  =  X (I c )-N(lC )«ox 
10  CONTINUE 

FR  =  FUNCTO(NOIM,X’X) 

FN  =  F  «0F  D  X*  DX 

DFCX  *  (FN-f R)/(2.U0*DX) 

C 

RETURN 


26 


1356 


END 


1357.  SUBROUTINE  R CLO P T <N , XO  ,F 0 ) 

1358.  C 

1359.  C  RC  LOP  T  R  £  CALLS  THE  CURRENT  BEST  MINIMUM  VALUE  TORI  EOUND  SO  FAR 

1360.  C  IRON  ALGORITHM  START,  AMO  THE  POINT  SORT  LOR  POSSIBLY  ONE  Of  THE 

1 36  T .  C  POINTS)  WHERE  EOPT  WAS  OBTAINED 

176?.  C 

1  *  6 T .  DOUBLE  PRECISION  Xo.fO 

1764.  DOUBLE  PRECISION  X  ,H , D X , VMVT , E PS , V MC OR , y CO R 

1365  .  DOUBLE  PRECISION  X RN1N , XRMAX , X  OPT , FOPT 

1366.  COMMON  /DINCOM/  X  (  TOC  .  20  >  ,H  (  20  >  ,  DX  ( 2  0)  ,  VMV  1< 2  0 . 1  9)  ,  F  PS  (  20 )  , 

1367.  1  V»COR  (  20  )  ,VCOR  (?G)  ,XRM1N(1  GO  >  .XRMAX  (  10  0)  ,XOI»iT<  ICO)  .FOPT  , 

176®.  ?  JE<20),ISVl<2C<19>.KtLN,KT]*,ND!MrNTRAJ.NlRAJRi 

1769.  3  ISEGBR  ,1  NX PB R f KPBR 0, NC T  ,lf EP.1NHP 

1370.  DIMENSION  XO(N) 

T  7  7 1  .  C 

1  772  .  DO  IQ  1  *  1 . N 

1373.  XO(I)  =  X  OPT  f 1 ) 

1374.  1C  CONTINUE 

1775.  FO  =•  FOPT 

1 3  7F  «  C 

1  377.  R  F TURN 

1 3  7P •  END 


1779.  SUBROUTINE  S TOOPT (N.XO , F 0 ) 

1380.  C 

1381.  C  S  T  COP  T  STORES  THE  CURRENT  BEST  MINIMUM  VALUE  TOPI  FOUND  SO  (IF 

138?.  C  FROM  ALGORITHM  START,  AND  THE  POINT  XOPT  (OR  POSfil«LV  ONE  OF  THE 

178'.  C  POINTS)  WHERE  F0P1  WAS  OBTAINED 

1384.  C 

136*.  DOUBLE  PRECISION  Kd,f 0 

1366  .  DOUBLF  PRECISION  X  ,H , 0 X  ,  VMV T  ,E PS ,V MCOR ,V CO R 

1787.  DOUBLE  PRECISION  X RM IN ,X RMAX ,X OPT , FORT 

1388  .  COMMON  /OIKCOM /  X (  ICO , 20 ) ,H (20 > , DX (? 0> , VMV TC20  ,  IS)  ,  EPS  (20) , 

1389.  1  V*1  COR  (  20)  fVCOR  (20)  .XRMIN(IOO)  .  XRMAX(  1000  «X  OPT  (lOO).FOPI, 

139C.  2  Jt  < 20)  .1 SVT ( 20 719)  .XGEN.XT  1M.ND1N.NTRA J.NTRAJR  , 

1791.  7  ISEGBR .INKPBR.KPbRC.NCF .IFLP.1NHP 

1392.  DIMENSION  XO(N) 

1793.  C 

1794.  DO  10  1  =  1.N 

1395.  XOPI(l)  =  X0(1) 

1396.  1C  CONTINUE 
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1?9?. 

159*. 

1599. 

1*00. 


1*01  . 
1*0?. 
1*05. 
1*0*. 
1*05  . 
1*06. 
l*c?. 
1*08. 
1*09. 
1*10. 
1411. 
1*1?. 
1*15. 
1*1*. 
1*15  . 
1*16. 
1*17. 
1*18. 
1*19. 
1*20. 
1*21  . 
1*2?. 
1*25. 
1*2*  . 
1*25. 
1*26  . 
1*27. 
1*28  . 
1*29. 
1*50. 
1*  Jl  • 
1*57  . 
1*5’. 
1*5*. 
1*15. 
1*56  . 
1*57. 
1*58. 
1*59. 

1  **0. 
1**1  . 
1**?. 
U*’. 
1***  . 
!***  . 


f  OPT  * 

BE  TUBN 
{NO 


DOUBLE  PRECISION  FUNCTION  FUNCTO(N.XI) 


1UNCT0  IS  C 
IN  THE  NUHEfi 
ThE  FUNCTION 

-  RESCALES 

-  CALLS  THE 

CURRENT 

-  CALLS  THE 

VALUE  OF 

-  POSSIBLY 

e£S  T  H 

minimi 


ALLEO  WHENtVfR  THE  VALUE  01  THE  FUNCL10N  f  IS  RElUlRED 
IICAL  INTEGRATION  PROCESS. 

I  FUN  CTO 

THE  VARIABLES  Of  CALLING  TH£  SUBROUTINE  VARSCA 
SUBROUTINE  RANGE  TO  TAKE  CARE  Of  THE  CASES  WHERE  THE 
POINT  X  IS  OUTSIDE  A  6IVEN  ADMISSIBLE  REGION 
US  £  R- SuPM.  IE*  FUNCTION  FUNCT  TO  ACTUALLY  COMPUTE  THE 

CALLS  The  SUBROUTINE  STOOPT  TO  UPDATE  THE  CURRENT 
INIHUH  FUNCTION  VALUE  FOPT  AND  THE  CORRESPONDING 
Z ER  X  OPT 


ooufLE  precision  xx 
OOUfcLE  precision  f  ,  r  ,  x  s 
DOUPLE  PRECISION  FUNCT 

DOUBLE  PRECISIAN  X  .H.DX'.VMVU  .EPS  .V  NCOS  ,  V  CO  R 
DOUBLE  PRECISION  X  RM 1 N  .ARM  AX  ,  X  OP  T',  FOPT 

COMMON  /OINCONi  Xf  100. 20)  ,H(20).  P»(?OT  ,VNV  T<20, 19)  ,f  PS  (20)-. 

'  YMCOR  C  20 1 aV COR <201  ,XRM1N< 1 00) , XRMAXC TOO) ,X0P1< 100) ,fOPT. 
2  IEE  20)  ,1 SVT(2Q.19),KGEn«KV 1M ,N D| M. NT RA J .NT R A JR . 

5  I S  E  6BR  .INKPBR.KPBNO.NCf ,If£P,INHP 
DIMENSION  X  X ( N ) 

DIMENSION  XSClOO) 

DO  1C  IX  x  1  ,H 

XS(IX)  =  XX  < I  X) 

10  CONTINUE 

DFSCALE  X-VARIABLtS 
CALL  VARSCA(N.XS) 

CONSTRAIN  THE  X-VARlAfiLES  WITHIN  BOUNDS 
CALL  RANGE <N ,XS .XRMIN.XRMAX  ,R) 

COMPUTE  THE  FUNCTION  VALUE... 

F  *  FUNCT (N,XS) *R 

...  AND  POSSIBLY  UPOATG  THE  BEST  CURRENT  MINIMUM 

if (f.lt.fopticall  uoopr (N.xs.n 

FUNCIC  =  F 
NCF  *  NC#*1 

RETURN 


«  *"»  *■  *  *  <  '  •  •  L*  P  *  a,*  *. 

‘  -  v  •  .  v  *■  •  -  v  V  / 

-  ■  -  "».'  rTr.*.  O.  O.  *..!«  . 


1446 


ENO 


1447. 
144?. 
1449. 
1  4  v  r  • 
14  5  1. 
145?. 

1453  . 

1454  . 
14  5  5  . 

U56. 

1*57. 


1  •.  'j  9  . 
1  '  . 
1  4  O  1  • 
1  ;  ( ? . 
1  •  C  7  . 
1.64. 
V  6  5  . 
t  466  . 
■  .67. 
146?  . 
■W.69. 
14  70. 
■'471  . 
.  /? . 
.4  7  5. 
’4  . 


SUF-ROU TIME  RANGE  (  N  ,  X  S  ,  X  R H I N  , X  «M  AX  ,R  > 

C 

C  RANGE  IS  CALLEO  BY  TMf  FUNCTION  EUNCTO  TO  TAKE  CARE  Of  THE  CASES 
C  WHERE  THE  CURRENT  POINT  X  IS  OUTSIDE  A  GIVEN  ADMISSIBLE  REG10* 

C 

DOUBLE  PRECISION  XS,XRM-1N,XRHAX,R 
double  PRECISION  A’.B.C  ,0  ,OLRHAX*RHAX  ,RR  t  XC 
DIMENSION  XS (N) .XKHINlNl  .XflHAX <NJ 
DATA  RHAX  71.035/ 

DATA  DLRH AX/BO. 590478254791599000/ 

C 

R  =  O.OC 
00  40  1  -  1  *  N 
A  *  XRMAX(I) 

C  =  XRH IN  (  1 } 

XC  *  XS  (I  > 

If  1XC.LE .A)  GO  TO  10 
B  1  A*  A -C 
RR  =  RHAX 

If  (XC.LT.B)  RR  -  DEXP((XC-A>«DLRHAX/<B -A))-1.D0 

«  =  R*RR 

XSCI)  =  X  RHAX  (  I  ) 

GO  TO  30 
1 n  CONTINUE 

lf(XC.GE.t>GO  TO  20 
D  =  CAC-A 
RR  *  RHAX 

If  1XC.GT.D)  RR  «  BE X P ( ( C-X C> *D LRHA X / (C -D>>-1.D0 
R  =  RARR 

X  S 1  I  )  -  XfiHlNEI  > 

?T  CONTINUE 

30  CONTINUE 

4C  CONTINUE 

c 

RETURN 

INC 


14  8  3.  INTEGER  FUNCTION  I'TOLCH  1 E  WAX  ,  f  HI  N  ,  TOLR  E  L  ,T  OLAB  S  ) 

’  '■  ?  4  .  t 

■.-a*.,  C  JTOLCH  DETERMINES  WHETHER  TWO  QUANTITIES  ARE  TO  BE  CONSIDERED  NU- 
C  HERICALLY  EQUAL  WITH  RESPECT  TO  an  ABSOLUTE  (OR  RELATIVE)  DIE  EE  RE.NCt 
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*-» 


1487.  C  C  h  1 1  F  R  ION  •  «MH1N  GIVfcN  TOLERANCES 
1 *8 a  .  C 

1489.  double  precision  e nax.enjn.jolrel.tolabs 

1490.  C 

i4«i.  mop  =  o 

149?.  C 

1491.  c  C  H£  C  K  PELAllvE  ClfffaE4.CE  AGAINST  TOtRfL 

1494.  I  f < DABS (f  MAX-fM IN) .L€. 10LREL*f  DABS <f HIN> ABs  < ENA* ))/ 2 .DO> 

14  9  5  .  1  1ST  OP 1  IS  TOP  *  1 

U96.  C 

1  497.  L  CHECK  ABSOLUTE  DiffEaEaCE  A6 A  |  N  S  T  TOLApS 

1498.  1  f I fNAX-f H IN .L£  .  10NA8S) 1STQP  3  1STOP*2 

1499.  ITOLCM  =  ISTOP 

1*00.  c 

1 5C 1  .  RETURN 

1507.  END 


15  01. 
1504. 
150*  . 
1*06. 
1  507. 
15CP  • 

1509. 

1510. 
1511  . 
1517. 

1511. 

1514. 

1515. 

1516. 

1517. 

1518. 

1519. 
15?0. 

1 5  ?  1  . 
1527  . 
152  *  . 
1524. 
1525  . 
152  A  . 
152  7  . 
152*. 
1529  . 
15  30. 
1531  . 
15  37. 


SUBROUTINE  IN1SCA<N,ND) 

INISCA  INITIALIZES  THE  CoONON  ASIA  /SCALE/  fOA  THf  SCALING  DATA 
DOUBLE  PRECISION  0  IS T , B I A S . GR A GR A, 6R A 

CONMON  /SCALE/  D1SK10, 10, 2  0>  ,  BI  AS  <  1 0  *20  »  *  M  AG«  A  Cl  0  , 10,70), 

1  6»A<10 ,20) ,N6RA<?0),LSCA,IDSCA  ,NX,NOBO 

DATA  NINSCA/10/ 

LSCA  a  -1 

If (N.6T.aKNSCA.0a.N.ta.I)«ETUPN 
LSCA  =  0 
NX  a  N 
NO  R  6  3  NO 
IDSCA  3  1 
DO  1  I D  3  1  .NOR D 

DO  2  IX  3  1 , N  X 

DO  3  IT  3  1.NX 

D IS  T  <1 X  ,1 1,18)  3  0.00 
GRAGRAfIX , I  I , 10 )  3  0. DO 
5  CONTINUE 

D  1ST  II X  ,1 X  ,1 D>  3  1  .DO 
B IAS  (I  X  ,1 0  >  3  0. DO 
6RA<  IX  ,10  )  3  0.60 
?  CONTINUE 

N6R A  < ID)  3  0 
1  CONTINUE 

RETURN 

END 


,***.■  V 


’v  '  '  %  '  .  -  '  »  ~  •  *  ,  *  *  - 


IS*.  t  * 


153?. 
1534  . 
1  535  . 
1336. 
1537. 
1538  . 
153<>. 
1540. 
1541  . 
154?. 
154?. 
1544. 


1  54 *  . 

1546. 

1547. 
1548  . 
1549. 
1  5  50. 
1551  . 
15  5  2. 
155?. 
1554. 
1  5  5  5  . 
1556  . 


1557. 
1558  . 
15  59. 
156  0. 
15  61. 
156?. 
156'. 

1564  . 

1565  . 

1566  . 
156'. 
1  56  p  . 
1569. 
157C. 
1571  . 
157?. 


SUbROUTINE  NOSCA 


c 

c 

c 


c 

t 


NOSCA  DEACTIVATES  IHi  SCALING 

DOUBLE  PRECISION  D I S 1 , b I  A S  ,  GR A 6R A , GR A 

COMMON  /SCALE/  D  1  S T £ 1 0 , 1 0  .  ?0 I , ti I  A S Cl  0 , 20  I , M A6R Aj£J 0 . 10 .203 , 
1  GRA£10,?0>,N6RA(20>,LSCA,IDSCA,NX,N0HD 


LSCA  r  -1 

fit TURN 
END 


C 

C 

C 


C 

C 


SUbROUTINE  SAGS  C  A  < It  > 

SE6SCA  SELECTS  THE  TlAjfCTORT  WHICH  MUST  BE  RESCALED 
DOUBLE  PRECISION  6  1ST , BIAS, cragra.gr  A 

COMMON  /SCALE/  DIS»£10,10,20),BIASf10,20),6RA6RA£10,10,?0>, 
1  GRA£10,20),NGRA£  20')  »LSCA,lDSCA,NX»NOkD 

10SCA  =  ID 

Rr  TURN 
END 


SUBROUTINE  vmCAU.I) 

C 

C  VARSCA  COMPUTES  THE  J>t  SC  ALf  D  VARIABLE  AX  4  B 
C 

DOUBLE  PRECISION  X 
DOUBLE  PRECISION  XB 

DOUBLE  PRECISION  0  I S I , B I  A S  ,  G R A GR A , 6R A 

COMMON  /SCALE/  DISIOO, 10, 20). blASElO,  20  >,CRA6RA  £10,10,20), 
1  GRA(10»20),NtRA(20T»LSC A  ,  I D$ C A  ,N X ,NORD 

DIMENSION  X£N),Xb£10) 

C 

lEfLSCA.LE  .0  >fi l T  URN 
DO  1  1  *  1  ,N 

XB£l)  =  E)  IAS  £  1  ,  IDSC  A» 

DO  2  J  «  1  ,N 

X6(l)  ‘  X6£I >«DI  VT(I,J,JDSCA)«X£ J> 


1577  . 
157*. 
1^75  . 
15  7ft. 
1577. 
l57«. 
15  79. 
1580. 


2  CONTINUE 

1  CONTINUE 

00  3  I  *  1  ,N 

»<1)  =  1B(1) 
5  CONTINUE 

HE  TUHN 
END 


1581. 

15*7. 
158  5  . 
158*  . 
1585  . 
I<86  . 
150  7. 

1580. 

1589. 
1590  . 

1  c  9  1  . 
1  c  9  ?  . 

15  9’. 
1  c  9  *  . 
1595  . 
1596. 
1697. 

1590. 

1599. 

1600. 

1 6  C 1  . 
1607. 
1  6  C  ’  • 
160*. 
1*05. 


SUBROUTINE  C UN S C A ( N  ,  » , 0 f D  * ) 

c 

C  CU0SCA  STOKfS  CUMULATED  STATISTICAL  DATA  ON  THE  111  ~  CDN  > IT  Mini  If  Of 
C  F ( A  X  *B )  W.H.T.  1 

C 

COUPLE  PRECISION  W t D  f  D  X 
COUPLE  PRECISION  DiCXMA 
COUPLE  PRECISION  0ISI,BIAS,6RAGRA,6RA 

CONNON  /SCALE/  0 1  S  I  (  1 )  ,4  0  ,2  0  »  •  61  AS  i  1  0  *20  )  .  CRAG  RA-C  T  fl  ,  Ifl  ?o>  . 

1  G«A<10,20),NGRA<20i,LSCA,IDSCA,NX,NOR» 

0IPENS10N  M (N) 

3  A  I  A  CFDXHA/I.Cft/ 

C 

IF  CLSCA.LE . 0 ) R E TURN 

IF  <0  AO  SEC  FOX) ,GT . D AD  KM  A ) R E T URN 

00  1  I  «  1  ,N 

DO  2  J  a  1,N 

6RAGHA < I , J ,1 »SC A)  *  6RA6RAEI .J.JDSCA )*D F D X AW < I > * Df OX«W  (J) 

2  CONTINUE 

CRACt.losCA)  =  GRAU  .IDSCAMCF  OX«W<  1) 

1  CONTINUE 

NGRACI 0  S  C  A )  -  NCRA  (IDSCA)«1 
C 

BE  TUHN 
ENO 


1606.  SUBROUTINE  ACTSCA 

1607.  C 

I6C».  C  ACTSCA  ACTIVATES  THE  RESCALING 

6  C  9  .  C 

DOUBLE  PRECISION  0  IS  T  ,  fa  I  A  S  ,  CR  A  GR  A  ,  GR  A 
M1*  COMMON  /SCALE/  C 1 S  T  (1 0  ,  J  0 . 2  0  )  *  bl  A  S  ( T  0 , 20  )  ,  GR  AG  R  A  Cl  0  ,  T  Q  ,2Q  >  , 

61?*  1  OR  A  < 1 0 .20) (NGKAE20) «  L  SC  A , 1 CS  CA.NX.NORO 

6  17. 


c 


1614. 

IMLSCA. £6. 0)LSCA  -  1 

1615. 

C 

1  616. 

RE  TURN 

1 6)  7  . 

END 

1 

2 

2 

2 

1 

1 

1 


16(8. 

1619. 

1620. 
1621. 
1622. 

1623. 

1624. 

1625. 

1626. 

1627. 

1628. 
1 6?9  . 

1630. 

1631. 

1632. 

1633. 

1634. 

1635. 

1636. 

1637. 
1  638. 
1639. 


C 

C 

C 

C 


c 


c 


SUBROUT INE  ROVSCAt JU,IR> 


POVSC A  ROVES  THE  SCALING  DATA  Of  ThE  UNPERTU 
POSITION  Of  THE  PERIL!  SO  £D  CONTINUATION 


«BE 6  CONTINUATION  TO  TNE 


DOUBLE  PRECISION  DIST .BIAS.eRAGRA.6RA 

COMRON  /SCALE/  DlSldO,T0,2O>,BIAS{lO,20)tGRA6RA«(10,1D,2Ql, 
1  6R*<10»20>»H6«A<20'>,LSCA,IDSCA  ,N*,N0R6 

IMLSCA.LT  .OjRETURN 
DO  1  1  «  1  ,NX 

DO  2  J  ■  1 ,kX 

D  1ST  (I  ,1 , I U)  «  DISTCI.J.IR) 

6RAGRA (I , J,1U)  *  GRAGIAt 1, J, IR) 

2  CONTINUE 

BIAS  f 1 ,  1U  )  «  blAS(I,IR) 

GRA(I.lU)  *  6RALI.1R) 

1  CONTINUE 

NGRA(IU)  «  NGRA(IN) 


RETURN 

END 


164G. 
1641  . 

1642. 

1643. 

1644. 

1645. 

1646. 

1647. 

1648. 

1649. 
J65H. 

1651  . 

1652  . 
165  *  • 
1654  . 


SUBROUTINE  UP0SCA(N,X) 

C 

r  r  i  ic  ™f  S“LI"6  NATRI*  A  AND  TN  I  BIAS  VECTOR  BBT 

C  CALLING  EIGSCA  AND  VANSCA 

C 

DOUBLE  PRECISION  I 

DOUBLE  PRECISION  A GR A l , A L A  1 ,AL PH A , AR COR , BI  AST 
DOUBLE  PRECISION  C D.CO R , D I STT , SN 
DOUBLE  PRECISION  EIGSCA 
DOUBLE  PRECISION  01 S I , 6 I A S ,CRA GR A, GR A 

CORNON  /SCALE/  D I S 1<10 * T 6 .2 0> * BI AS  1 1 0* 20> • GRA6RA 41 0* 1 0 « ?0> • 

1  £RA(10*20>*N6RA<20<>,LSCA«1DSCAINX»NORD 
DIMENSION  X ( N ) 

DIRE  NS  ION  DI STT (10,10) ,B I AST (10) .COR <10*  101 
DA 1  A  ALPHA  / 0. 3  D  0/ 


33 


.a 


M  fJ  ^ 


1 

«? 

1 

2 

1 


1 

2 

2 

1 


1 

1 

1 


1 

2 

2 

5 

3 

2 

2 

1 


1 

1 


1655. 

C 

1656. 

lMl5CA.Lt  .0  )Rt  TURN 

1657. 

10  -  1C5CA 

1658  . 

TO  2 

1659. 

AGMAl  -  1  .  DO/DHl  t  <  »LOA  T  (NGRA  1  I  (,)  )> 

1  66f*  . 

AMCOR  *  O.CO 

1661  . 

00  3  1  =  1,NX 

166?. 

CO  *  J  =  1,1.1 

1663  . 

COR(I.J)  »  AGRA  1*6R  A6RAC  T  ,J  ,  J  D> -A&fl  AI  *6  RA<  I  ,U>)  *A6RAI«6RA 

16  6*  . 

AMCOR  *  C  M  AX  H  ARC  OR  .DABS  1C  OR  1  1  ,  J  >  )  > 

1665  . 

* 

LON  T  IM  UE 

1666  . 

w 

CONT 1NU t 

1*67. 

I  MAHCOR.  Lt.fi. ooogo  TO  ,l2 

1668  . 

DO  1  I  ■  1  ,N  X 

1669  . 

SO  It  J  =  1  ,  N  A 

1670  . 

COR  1  1 , J )  *  CCRII  ,))/AMCOR 

1671  . 

1  1 

COR  T  INUE 

167?. 

1 

CONTINUE 

16  7?. 

ALAI  =  EXGSCAUOR) 

167*. 

CD  -  ALAI* (1 .DO ♦ALPHA ) 

16  75  . 

DO  5  1  =  1,NX 

1ft76. 

coflti.i )  -  coRM,i)>ro 

1677. 

P  1  A  S  T  1  J  )  x  1(1) 

1678  . 

» 

CONTINUE 

16  79. 

CALL  VARSCAlNA.BXAST) 

1680. 

SN  =  O.DO 

1681  . 

DO  6  I  =  1  ,N  t 

168?. 

DO  7  J  =  1.NX 

168*. 

C1STT1I.J)  *  0.00 

1 6  8  ^  . 

(0  M  >  1,111 

1685  . 

D1STT1I.J)  x  AISTTU,  J)-OIST(  I  .  A  .  JO  >  «  COM  It  ,  J  > 

1686. 

8 

CONTINUE 

1687. 

SN  x  SN*D I  ST  11 1 , J ) a*2 

1688. 

7 

CONT 1NUE 

1689. 

6 

CONT INUE 

1690. 

SN  x  1  .OO/DSflRT <SN7DBL£lfL0AT(NX)>) 

1691  , 

DO  9  i  =  1,NI 

169?. 

PlASCl.lD)  X  bl AS  T  1 10 

J69*  . 

CO  10  J  *  i,n 

169*  . 

CIST (I ,J , ID)  x  SN*0ISTT(  1,  J) 

1695  . 

b  IAS  11  «  1  C  )  =  BI  ASH  ,1D>-DI  ST  <1  ,J,  I  D)  *A(  J  ) 

1696  . 

GRA6RA11 , J ,1 O)  •  O.DO 

1697. 

10 

CONT INUE 

1698. 

GR  A  1  I  ,  I  D)  *  0.00 

1699  . 

0 

CONT  INUE 

1  70 C  . 

N6RA1I 0)  *  o 

17C1  . 

•> 

CONT INUE 

170?. 

1  ? 

CONTINUE 

1  70  T  . 

c 

170*. 

RETURN 

1705. 

END 

,ID> 


-1 


■_»  -T«  "7;  ■  ■' 


rr  r.-.v.v  rr:  rv  rr  r 


'71 


1 

1 

1 


C' 

J 

3 

7 

7 

1 

1 

1 

1 

2 

i 

1 


170ft. 
170?. 
17o8  . 
1700. 
1710. 
1711  . 
171?. 
1713. 
1714  . 
1715. 
1716  . 
1717. 
171 1  . 
171V. 
1  7?n  . 
1771  . 
1 7? ?  . 
1777. 
1 7?  4  . 
1 7? 5  • 
1776. 
17?7. 
177?  . 
1 7  ?  9  . 
I73r. 

1731. 

1737. 

1733. 

1734. 
1725. 

1736. 

1737. 
1738  . 
1739. 

1 74  C. 
1741. 
1747. 
1743. 

1744  . 

1745  . 

1  74  (  . 
1747. 


COUPLE  PS  £  Cl  SION  EUNCT10N  E16SCAEC0R) 

C 

C  (1GSCA  COPPUTLS  1 H  f  L  AR  6  f  5  T  EIGENVALUE  Of  A  PAfRlX  USED  fOR  RESEA- 
C  UNO,  S1ART1NG  IR0P  A  R  A  N  DO  PL  Y -C  H  OS  E  N  EST1PATE  (0B1AINID  BY  CALLING 
C  THE  SUBROUTINE  UNI  1 R  V  )  Of  THE  CORRESPONDING  EIGENVECTOR 

DOUBLE  PRECISION  COR 
DOUBLE  PRECISION  ALA  1 , ALAI 1 ,ALAlO 
DOUBLE  PRECISION  P RE C .SUN ,w ,NW 
DOUBLE  PRECISION  0 1 S 1 . b 1  AS , 6R A GR A. GR A 

COUPON  /SCALE/  D 1 S 1 < 1 C , 1 C , ? 0 ) , 6 1 A S ( Y 0. 70 > , SR A6 R Atl 0 , 1 0 ,?0 > , 

1  GR A(10.20).NGRA<20J,LSCAtlDSCA,NX,NORD 
D I  PENS  I  ON  CORCIC.IQ) 

DIPENSION  U<  10  )  •  UM.CIQ) 

DATA  PREC  71.0-37 
DATA  NRPIN  710/ 

DATA  NR  PA  X  7100/ 

c 

CALL  UNIXRV<NX,W> 

ALAI  *  0.D0 
DO  1  IS  =  1  . NRH  A  X 

ALA10  -  ALAI 
SUW  =  0.D0 
DO  2  IX  *  1,NX 
NW(IX)  =  C.DO 
DO  3  J  X  r  1 f  NX 

W  N ( 1X1  =  UW(IX>«COR(IX,JX)«U<JX) 

3  CONTINUE 

SUN  =  SWW«UU(IX>*«2 
7  CONTINUE 

ALAI  =  DS6RT ( SUM) 

ALA11  «  1. DO/ALAI 

If (IR.GE. NRPIN. AND. ALA1«PREC.6T.DABS(ALA»-ALA10))60  TO  4 
DO  5  IX  «  1 , N X 

N(IX1  «  N  W ( 1 X ) • AL A  1 1 

5  CONTINUE 

1  CONTINUE 

4  CONTINUE 
EI6SCA  «  ALAI 

b 

RETURN 

END 


::1 


m 


174?  . 
1749. 
I75n. 
1751  . 
175?. 
175  3. 


DOUBLE  PRECISION  EUNCT10N  CNAOS(INII) 

CHAOS  GENERATES  A  RANDOM  SAMPLE  fROP  ONE  OUT  Of  fOUR  POSSIBLE 
PROBABILITY  DISTRIBUTIONS  USING  RANDOM  NUMBERS  UNIfORPLV 
DISTRIBUTED  IN  40.1)  GENERATED  BT  THE  fUNCTJON  UNIfRO 


35 


~A 

m 


':'A 


1754.  C  1N12  IS  AN  INPUT  PA*A MEIER  AS  FOLLOWS 
1755  .  C 

1756.  C  I N 1 2>  0  INITIALIZATION  WITH  SLED  INIZ. 

1  757.  C  I N 1 2  *0  STAND  ADD  6AUSSIAN  DISTRIBUTION. 

1 75 A .  t  INI2  =  -1  CAUCHY  DISTRIBUTION. 

1759.  C  I N 1 2  *~2  UNIFORM  DISTRIBUTION  IN 

1760.  C  OTHERWISE  UNIfORN  DISTRIBUTION  IN  (  0,*1>. 

1761.  C 

176’.  DOUBLE  PRECISION  UNI f R 0 , PA  I , A , B 

176*.  C 

1764.  DATA  PAI/3  .  1 4 1 5 9 i6 5 3 5g 9 79 32  A  DO / 

1765.  C 

1766  .  1M1NI2.LE.0I  60  TO  10 

1767.  C 

176p.  C  INITIALIZATION. 

1769.  C 

1770.  CHAOS  *  uNIFrOCInU) 

1771.  RETURN 
177?.  C 

177*.  10  CONTINUE 

1 774 .  A  x  UNIFRD(O) 

177*.  1M1NIZ.NE.0I  60  TO  20 

1776.  B  =  UNIFRDCOJ 

177’.  C 

17  78  .  C  GAUSSIAN  RANOON  NUMBER  BY  POLAR  HETHOD 
1770.  C 

1780.  CHAOS  -  DS6RT(-?.DQ*DL0G<A))*DC0S(P*I*B) 

1781.  C 

178?.  RETURN 

178*.  20  CONTINUE 

1784.  C 

178*.  C  UNIFORM  RANDOM  NUMBER  IN  <0«1> 

1  786.  C 

1787.  CHAOS  *  A 

1788.  C 

1  780.  C  C  AU  CM  ¥  RANDOM  NUMBER  B>  INVERSE  TRANSFORMATION 

1790.  C 

1791.  IMINIZ.EQ.I-D)  CHAOS  -  DS  INC  PA  IP  A) /D  COS<  PAI  *  A  » 

1792.  C 

179*.  C  UNIFORM  RANDOM  NUMBER  IN  C ~T . ♦ 1 > 

1794.  C 

1795.  IF<lNlZ*Efl.(-2>>  CHAOS  »  2.D0«A-1.D0 

1796.  C 

179’.  RETURN 

179°.  END 


1799.  OOUBLE  PRECISION  FUNCTION  UNIFRD(INIZ) 

1 8cc  •  C 

1601.  C  UNI F R D  GENERATES  THE  RANDOM  NUMBERS  UNIFORMLT  DISTRIBUTED  JN  <0,11 

180?.  (  EXPLOITING  THOSE  GENERATED  BY  ALKNUT  WITH  A  FURTHER  RAND0M1ZAT  :0N 


3fi 


1803.  L  If  THE  1 MPUT  PARAMETER  InW  IS  N01  0 
180* •  C  THE  BANCO*  NUMBER  GENERATOR  lj  RnMIAuZEO 

1805.  C 

1806.  DOUBLE  PRECISION  A',B,t,X 

1807.  DOUBLE  PRECISION  XO ,P, PO ,P1 ,P2  ,R 1 , R2 

1808.  DOUBLE  PRECISION  I INV 
180V.  C 

1810.  DIMENSION  XC61) 

lUl*  C 

1 9  1  2  .  DATA  NSEH/61V  .fjBlp/100/ 

1813.  DATA  A,  B,  C/-J.5D0.5.5DC,-2.0DO/ 

181*.  DATA  E1NV/3.5D-5A 

1915.  DATA  IRE* /O/ 

1816.  DATA  PO/3.DO/,P1,P2/1.DO,3.DOf  ,R1.R2E0.25DC.0.75dO/ 

1817.  C 

1818.  IM1NIZ.HE  .O.OR.lRlM.f  V.O)  GO  TO  10 

18 1 V  .  C 

1820.  it)  ■  IDE* 

1821.  XO  =  X( 10) 

1822.  C 

1  fi  2  T  •  t  NCNLINEARI / A  T I  ON  OE  XO  TO  AVOID  LONG-D 1$ |ANCE  LINEAR  *  EL* T 1 0N6N I  f. 

18?*.  C 

1825.  1E(10.£E.EJNV>X0  *  D*OD  (  1  .DO/*  0. 1  .  DO  ) 

1826.  C 

1827.  C  UPDATE  A  COMPONENT  OE  !THt  VfCTOR  X  ... 

1828.  C 

182V.  CALL  ALXNUT<NRIM,X,IR£M) 

1830.  C 

1831.  C  ...  AND  EURTHER  RANDOMIZE 

1832.  C 

1633.  UNIERO  *  OMOD<XO*X<IO) .1 .DO) 

1834.  C 

1835.  RETURN 

1836.  C 

1637.  C  INITIALIZATION  OE  THE  RANDOM  NUMBER  GENERATOR 

1838.  C 

1839.  1C  CONTINUE 
184".  C 

lp*1.  P  *  PO-I.OO/OBLE  <EkOATllABS<lNl7»«100.0> 

18*2.  DO  23  X  =  1 , NRE M 

1843.  C 

1  1844.  P  *  t*P*(a»P»E) 

1  1645.  C 

1  1846.  C 

1  ‘■47.  x  C  K )  *  *1*(fc2-Rl)*CP-Pl)/«P2-Pl) 

1  1848.  2C  CONTINUE 

1  1849.  C 

1850.  IREN  *  0 

1851.  t 

1852.  CO  30  X  *  J.NRlp 
185'.  C 

1  1854.  CALL  ALKNuT(nrEn«X( IREM) 

T  1655.  C 

1  1856.  30  CONTINUE 

1  1857.  C 

1856.  UNIERO  *  X  <T  > 

1859.  C 


186(3.  RETURN 

18t1.  END 


18t?  . 
186  *  . 
1864. 
1865  . 
1*66  . 

1867. 

1868. 
1*69. 

\»ro. 
i  e  / 1 . 

187?. 
1  8  7  *  . 
187*  . 
18  75  . 

1876. 

1877. 
1878  . 
18  7«. 
1«(-0. 
1881  . 

1887  . 
188  *. 
188*. 
I»a* . 
1886. 
1887, 

1888  . 
1889. 
1897  . 
1891  . 
189?  . 


SUBROUlJKE  ALKNUKNREM  ,X  ,1RFM> 

C 

C  UPDAIES  THE  COMPONENT  IRtN  Of  THE  MIEN -VECTOR  *  yilH  A  rAND <j«  MUpBER 
C  UMFORNll  DISTRIBUTER  IN  (0,1)  BT  BEANS  OF  THE  ALGORITHM 

c  o(  p  n  chill-boor  t ,  rooiuei  as  suggested  bt  brent,  suited  in 

C  o.t.KNUTH.  The  ART  Of  COMPUTER  PROGRAMMING,  SECOND  EDITION, 

C  SECOND  VuLu"£t  S£M1hUH«R]CAl  A  1.  ^OR  IT  hMS  ,  ADDIS  ON -WES  LET 
C  PUB.  CO.,  READING  (Tv8»),  PP .  26~?8. 

C 

DOUBLE  PRECISION  X 


C 

DIMENSION  X(NREM) 

C 

DATA  N1 ,m2 /?*  ,55  7 

C 

If (ISEM.NE  .0)  GO  TO  10 
C 


IRE"  r  HR  f  M 
II  =  NREM-Nl 
I?  =  NREM-N2 


C 

10  CONTINUE 

c 

I (  1 R  EM )  =  DMOD(X(lt)«X(r2),1.D0> 

c 

IREM  *  1*M0B (IkEM'HREm) 

II  =  1 »MOD( I 1,NREM > 

I?  *  1 *MOD (I  2 ,NREM  ) 

C 

Rf TURN 


f  NO 


1  E  9  T  .  SUBROUTINE  GAUSRV(N,N> 

I«9*.  C 

E“9‘.  C  GENERATES  A  RANDOM  VECTOR  SAMPLE  FROM  AN  ■ -D IN FNS 1  ON AL 
1896.  C  NORMAL  DJS I RI UUT ION 
18  9  7.  C 

1898.  OOURLE  PRECISION  W.X.T.R 

1899.  OOUl-Lt  PRECISION  CHAOS 

|90C.  ( 
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3.-  APPLICAZIONE  DELL ' ALGORITMO  ALL ' ANALI SI  CONFORMAZ IONALE 


L'algoritmo  Jescntto  nel  paragrafo  2  e  stato  concepi- 
to  un  uso  del  tutto  generale. 

Per  lo  studio  delle  posizioni  di  equilibrio  delle  mo- 
lecole  nel  caso  di  geometna  di  valenza  rigida,  la  funzio- 
ne  da  minimizzare  e  l’energia  conf ormaz ionale 

E  (  0  )  =  E  (  ) 

_  1  m 

in  cui  gli  argomenti  ♦  ...$  sono  gli  angoli  di  torsione 

1  m 

1  iber l . 

II  calcolo  effettivo  di  E($  )  viene  effettuato  come  se¬ 
gue  . 

Dati  gli  angoli  ♦  .  ..$  si  calcola  direttamente  il 

1  m 

contributo  torsionale  alia  energia  E($  ),  le  coordinate  car- 
tesiane  degli  atomi  e  successivamente  i  potenziali  elettrostatici 
e  quelli  di  Lennard -Jones  tra  coppie  di  atomi  non  legati  nel- 
la  conf  ormaz  ione  in  oggetto.  La  energia  E(  ♦  )  e  ottenuta 
come  somma  delle  energie  torsionale,  elettrostatica  e  di 
Lennard  -Jones . 

Nella  Figura  1  e  descritto  schemat icamente  il  diagramma 
di  flusso  relativo  agli  algoritmi  di  calcolo. 

Come  esempio  di  applicazione  del  nuovo  algontmo,  consi 
dei  lamo  il  fraimento  (di  DMA)  di  desossir lbosio-monofosf ato  mostrato 
in  Figura  2,  che  nel  seguito  indicheremo  con  la  sigla  SPS 
(Sugar-Phosphate-Sugar).  Per  questo  frammento  Matsuoka,  Tosi 
e  Clement l  calcolarono,  con  un  metodo  quantomeccanico  ab-ini 
tio(.4..ri  1  le  energie  di  cento  conf  ormaz  10m  ottenute  vanan- 
do  gli  angoii  di  rotazione  interna  e  ,  ;  ,  a,  8  ,  y  ,  e  man 


.  -V 


Una  singola  prova  e  arrestata  (al  termine  di  un  perio- 
do  di  osservaz ione ,  e  dopo  aver  eliminato  la  traiettoria  pe£ 
giore)  se  tutti  i  valori  finali  della  f  nelle  rimanenti 


traiettorie  risultano  -  entro  tolleranze  numeriche,  ed  even- 
tualmente  in  punti  finali  diversi  -  uguali  tra  loro  (arresto 
"uniforme" ) . 

La  prova  e  in  ogni  caso  arrestata,  alia  fine  di  un  pe- 
riodo  di  osservaz ione ,  se  si  e  raggiunto  un  dato  numero  mas- 
simo  di  periodi  di  osservazione . 

La  prova  e  considerata  un  successo  soltanto  nel  caso 
di  un  arresto  uniforme  su  un  valore  finale  che  sia  (numerica 
mente)  uguale  al  piu  basso  valore  trovato  per  f  dall’inizio 
dell ' algor itmo . 

Le  prove  sono  ripetute  cambiando  i  valori  di  alcuni  pa- 
rametri,  e  1 ' intero  algoritmo  e  arrestato,  al  termine  di  una 
prova,  se  si  raggiunge  un  dato  numero  di  arresti  uniformi 
tutti  al  livello  del  migliore  valore  di  f  trovato,  o  in  ogni 
caso  se  si  raggiunge  un  dato  numero  massimo  di  prove. 

L' algoritmo  considers  di  aver  trovato  ll  minimo  globale 
se  si  e  avuto  almeno  un  arresto  uniforme  al  livello  del  mi- 
gliore  valore  trovato  per  f. 


6. 


in  cui  e  la  lunghezza  del  passo  di  integrazione  temporale, 

t  =  h  +  h,+h  +  ...+  h  ,  r  e  u  sono  due  vettori  aleatori  in 
k  0  1  2  k-1  -k  -k 

n-dimensioni  scelti  il  primo  da  una  distribuzione  uniforme 

sulla  sfera  unitaria  e  il  secondo  da  una  distribuzione  gaus- 

siana  standard,  e  ^  e  una  approssimazione  a  differenze  fi- 

nite  della  derivata  direzionale  nella  direzione  r, 

— k 

L'algoritmo  considers  un  numero  fisso  di  traiettorie 
generate  dalla  (2),  che  si  sviluppano  ( simultaneamente  ma 
indipendentemente  una  dall'altra),  a  partire  dalle  stesse 
condizioni  iniziali,  durante  un  "penodo  di  osservazione" 
in  cui  il  coefficiente  di  rumore  di  ogni  traiettoria  e  mante 
nuto  costante,  mentre  e  il  passo  ix^  usato  per  calcola- 
re  ^  sono  aggiustati  automat icamente  per  ciascuna  traietto¬ 
ria, 

A1  termine  di  ogni  periodo  di  osservazione  le  traietto¬ 
rie  sono  confrontate,  una  di  esse  viene  scartata,  tutte  le 
altre  continuano  imperturbate  nel  periodo  di  osservazione 
seguente,  e  una  di  esse  e  prescelta  per  dare  luogo  a  una  "d_i 
ramazione",  e  cioe  a  una  seconda  cont inuazione  della  stessa 
traiettoria,  che  differisce  dalla  prima  solo  per  i  valon 
iniziali  di  e  e  4  x,  ma  che  si  considera  avere  la  stessa 
"stona  passata"  della  prima. 

Il  numero  totale  di  traiettorie  simultanee  rimane  per- 
cio  invariato,  e  la  seconda  continuazione  prende  -  dal  punto 
di  vista  del  programma  di  calcolo  -  il  posto  della  traietto¬ 
ria  scartata. 

L’insieme  delle  traiettorie  simultanee  e  considerate 
come  una  singola  "prova" ,  e  l'algoritmo  compieto  e  un  insie 
me  di  prove  npetute. 


L'equazione  (1)  si  pud  considerare  come  caso  limite  del^ 
l'equazione  (del  2°  ordine)  di  Langevin,  quando  si  trascura 
ll  termine  inerziale. 

L'uso  dell ' equazione  (1)  e  suggerito  dal  comportamento 
per  t  molto  grande,  del  processo  aleatorio  x(t)  soluzione 
dell 'equazione  (1)  con  e  costante,  a  partire  da  un  punto 
iniziale  x„:  si  ha  infatti  che  -  sono  ipotesi  molto  poco  re- 
strittive  sulla  funzione  f  -  la  densita  di  probability  di 
x(t)  all'istante  t  tende  ,  per  t  — ->  ®  ,  a  una  densita  di 
probability  limite 

-  -A-  f (x) 

p(x)=  Ae 

indipendentemente  dal  punto  iniziale  xD  (A  e  una  costante 
di  normalizzazione ) ,  che  risulta  tanto  piu  concentrata  intor 


no  ai  minimi  globali  di  f  quanto  minore  e  e  ,  fino  a  diven- 
tare,  nel  limite  per  e  — >  0,  una  somma  pesata  di  delta 
di  Dirac  centrate  sui  minimi  globali  (p.  es.  in  una  dimensio 
ne  (N  =  1)  se  f(x)  ha  due  minimi  globali  a  e  b  la  densita 
p(x)  tende,  per  e  — >  0,  alia  densita 

Y«(x-a)+(l-Y)  «  (x  -  b) 

_  1 

ove  y  =  (1  +/ B / a )  essendo  a  =  f"(a)  >  0  e  6  =  f"(b)>  0). 

Dc'to  ll  punto  iniziale  xQe  la  discretizzazione  usata  per 
la  ( 1 )  ha  la  forma 

*k  +  i  ~  ~  ^  -k  +  £  ^  fck  ^  —  k 


D 


k  =  0,1,2,... 


4. 


2.-  DESCRIZIONE  DELL ' ALGOR I TMO  PER  LA  RICERCA  DEL  MINIMO 
GLOBALE 

L'algoritmo  di  minimizzazione  globale  adottato,  che  si 

basa  sul  metodo  proposto  da  F.  Aluf f i-Pentini,  V.  Parisi,  e 

F.  Zirilli  in  [  1  ],  e  descritto  in  dettaglio  in  [  2  j,  mentre  la 

e 

sua  traduzione  in  un  insieme  di  sottoprograimd  FORTRAN^in  [3]. 

II  metodo  ricerca  un  punto  di  minimo  globale  di  una  fun 

zione  f(x)  =  f(x,,  x.  ...,  x  )  di  n  variabili  reali,  seguen 
—  1  2  n  — 

do  le  traiettorie  generate  da  una  opportuna  discretizzazione 
numerica  dell ' equazione  dif f erenziale  stocastica. 

(1)  dx  =  -  Vf  dt  +  e  dw 

la  partire  da  una  condizione  iniziale  x(0)  =  x0  ]  essendo 
7 f  il  gradiente  di  f(x),  w(t)  un  processo  stocastico  di  Wie 
ner  standardizzato  a  n  dirnens  ioni ,  e  e  un  coefficiente  posi. 
tivo  ("coefficiente  di  rumore" )  che  consideriamo  variabile 
nel  tempo. 

L’equazione  (1)  -  generalmente  considerata  con  e  co- 

stante  -  e  nota  come  equazione  di  Smoluchowski  e  Kramers, 

ed  e  usata  p.  es.  nello  studio  della  diffusione  degli  atomi 

nei  cristalli,  o  nello  studio  di  certe  reazioni  chimiche. 

In  queste  applicazioni  l'equazione  (1)  rappresenta  una 

diffusione  attraverso  barriere  di  potenziale  sotto  l'azione 

di  una  forza  aleatona  e  dw,  essendo  f  il  potenziale  e 
2kT 

e  =  -  ,  ove  k  e  la  costante  di  Boltzmann,  T  la  tempera- 

m 

tura  assoluta,  e  m  un  coefficiente  di  massa. 


potuto  colmare  tale  lacuna  grazie  all ' applicazione  di  un  nuo 
vo  metodo,  ispirato  alia  termodinamica  statistica,  con  il 
quale  il  minimo  globale  e  ottenuto  numer icamente  seguendo 
le  traiettorie  di  un  sistema  di  equazioni  dif f erenziali  sto- 
castiche . 

Nel  paragrafo  2  viene  descritto  il  metodo  di  minimizza- 
zione  globale  adottato,  nel  paragrafo  3  il  metodo  viene  ap- 
plicato  alio  studio  dell'energia  conf ormazionale  delle  mole- 
cole  ed  in  particolare  si  considera  un  esempio ;  nel  paragra¬ 
fo  4  vengono  tratte  alcune  semplici  conclusioni. 


prieta  di  raggiungere  un  minimo  locale,  che  spesso  e  il  piu 
vicino  al  punto  da  cui  si  intraprende  la  minimizzazione,  e 
di  non  poter  fornire  quindi  alcuna  garanzia  che  l'energia 
della  conformazione  finale  trovata  sia  la  piu  bassa  possibi- 
le  per  la  molecola  in  questione. 

L'unico  modo  che,  in  linea  di  principio,  assicura  il 
raggiungimento  del  cosiddetto  minimo  globale  e  1 ' esplorazio- 
ne  "a  tappeto"  dell ' iperspaz io  conf ormazionale :  una  possibi¬ 
lity  puramente  teorica,  in  quanto  il  numero  di  valutazioni 
della  funzione  E(x  )  che  dovrebbero  essere  eseguiti  richiede 
rebbe  tempi  di  calcolo  proibitivamente  elevati. 

Questo  discorso  vale  anche  se  si  mantiene  rigida  la  geo 
metria  di  valenza  (lunghezze  di  legame  ed  angoli  di  valenza 
costanti)  e  ci  si  limita  all ' esplorazione  del  sottospazio 
torsionale:  si  consideri  ad  esempio  che,  per  una  molecola 
nella  quale  l'energia  E(x)  dipende  da  cinque  angoli  di  rota- 
zione  interna  una  esplorazione  suf f icientemente  accurata  da 
poter  sperare  di  trovare  tutti  i  possibili  minimi  richiede 
che  l'energia  sia  calcolata  ad  intervalli  angolari  di  al  piu 
15°  per  ogni  legame  ruotato:  questo  comporta  il  calcolo  del- 
l'energia  in  circa  8  x  10^  punti  dell ' iperspazio  conforma- 
zionale.  Se  gli  atomi  contenuti  nella  molecola  sono  qualche 
decina  il  numero  di  valutazioni  di  funzioni  di  E,  ed  i  tem¬ 
pi  di  calcolo,  anche  su  elaboratori  (scalari)  di  notevole 
potenza,  sono  proibitivi.  La  conclusione  che  ne  consegue 
e  che  non  e  possibile  trovare  in  modo  diretto  il  minimo  glo¬ 
bale  delle  funzioni  di  energia  potenziale  intramolecolare . 

Come  verra  mostrato  in  questa  comunicazione,  abbiamo 


1.-  INTRODUZIONE 


Uno  dei  problemi  piu  importanti  nello  studio  teorico 
delle  proprieta  molecolari  e  costituito  dalla  ricerca  delle 
strutture  piu  stabili  di  una  molecola.  Tali  strutture  corri- 
spondono  ai  punti  dell ' iperspaz io  conf ormazionale ,  definito 
dal  vettore  delle  coordinate  interne  x  =  (xl(  x  .  .  .  . ,  x  ) 
(dove  N  e  il  numero  di  atomi  contenuti  nella  molecola),  nei 
quali  l'energia  potenziale  intramolecolare  E(x)  e  minima. 
Tutti  questi  punti  sono  caratterizzati  dall '  annullamento  de_l 
le  derivate  parziali  prime  di  E,  e  dal  fatto  che  la  matrice 
delle  derivate  parziali  seconde  sia  una  matrice  non  negativa; 
detta  matrice  determina,  attraverso  la  legge  di  distribuzio- 
ne  di  Boltzmann,  la  popolazione  degli  stati  conformaziona- 
li  intorno  al  minimo. 

Tra  i  vari  minimi  della  funzione  E(x)  nell ' iperspazio 
conformazionale  e  di  maggiore  interesse  in  chimica  o  biolo- 
gia  il  minimo  o  i  minimi  globali  cioe  i  punti  x*  tali  che 
per  ogni  x  sia: 

E(x*)  <  E(  x ) 

Data  l'elevata  complessita  del  problema,  la  ricerca  dei 
minimi  globali  della  funzione  di  energia  potenziale  non  puo 
essere  eseguita  per  aa  analitica  e  richiede  1  ’  impiego  di 
procedimenti  numerici.  Esistono  numerosi  programmi  di  calco- 
lo  per  la  minimizzazione  di  funzioni;  ma,  indipendentemente 
dalle  loro  caratteristiche  peculian  e  dalle  condizioni  ot- 
timalidi  applicability,  essi  sono  contraddistinti  dalla  pro- 
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Ricerca  di  conformazioni  di  minima  energia  potenziale  intramo- 
Locolare  mediante  un  nuovo  metodo  di  minimizzazione  globale 
(Search  for  min ' mum-intramolecular-potential  patterns  by  means 
of  a  new  method  for  global  minimization) 

by  C.  Tosi,  R.  Pavani ,  R.  Fusco,  F.  Aluf f i-Pentini ,  V.  Parisi, 
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1 . 

7. 

•» 

-  • 
4. 
4  . 
7. 
7. 
P. 

10. 
11  . 
1?. 
1 1  . 
14. 
1'. 
17. 

1  7  . 
IP. 
1<-  . 
7  0. 

21  • 

22. 

2  ’  • 
24. 

2'. 

27  . 


27. 

•>  a 

2«I 

1C. 

SI. 

3?. 

S'. 

3  4  . 
;■> . 

37  . 

37. 

3P. 


t 

C 

C 

c 


MAIN  PROGRAM  IS  AMP  L 1  Vf RS ION) 

CALLS  SIGMA  VIA  1  Hi  DRIVER  SUBROUTINE 

couple  precision  xo.xmih.fmin 

DIMENSION  X0C2)  .XHlNi?) 

TEST  PROBLEM  DATA 


SIGH  A1 


C  PROBLEM  D1MENsI0n 
N  =  2 


INITIAL  POINT 

*0(1)  =  0.00 
*0<2)  -  0.00 

SET  INPUT  PARAMETERS 
NS  U  C  =  3 
1PRINT  =  C 

CALL  ORIyER  SUbR0UTlNE  SrGMAI 

CALL  S 16MA 1(N ,X0 ,NSUC ,1  PR  I  NT ,XMlN,FMlN,NFEV.loUT) 

STOP 

END 


OOUPLE  PRECISION  (UNCTION  (UNCI  (N,X> 

c 

C  CCMPUTES  THE  VALUE  AT  X  Of  THE  SIX-HUMP  CAMEL  (UNCTION 

C 

couple  precision  x^xx.iy 

DIMENSION  X(N) 

XX  =  1(1)1 X( 1  ) 

»Y  *  XE2)*X(2  ) 

(UNCI  «  ((XX/3.D0~2.1D0)*XX*4«D0)*XX+X(1)aX(2) 

1  ♦4.D0*(TT-1  .  DO  >•  T  T 

RETURN 
t  N  0 


1? 


*>-*.•  v. 


.  v  kK*“\v  „*•  ,.*«  •  .% 


•F TN.S  ACM2A.F ILtTt  SI .TPF1.F ILETEST 
ft*  10Ri*  02/12/85-22:02(0.) 

1 .  C 

?.  C  t  ALGOR  1 T  WH  SIGMA) 

7.  C  MAIN  PROGRAM  (TEST  VERSION) 

«.  C  (CALL  SIGMA  VIA  THE  DRIVER  SIGMA1  > 
7  .  C 


f  . 
7. 
*. 
9. 
10. 
1  1  . 
17. 
1  *. 
1*- 
IS  . 

1*- 

17. 

18. 
10. 

?0. 

2  T  . 
22. 
2T. 
2*. 
75. 
26. 
27. 
2  8  . 

29. 

30. 

31. 

32. 

33. 
3*. 

35. 

36. 

37. 

38. 

39. 

40. 
A  1  . 
47. 
4  T  . 
44. 
4<  . 
46  . 
47. 

4  P  . 

49. 

50. 

3’  . 

57. 

5*. 

5*. 

5  5. 


DOUBLE  PRECISION  f Ml N ,XQ ,XN AX6 L . KM  IN ,XM ING L 

C  COMMON  AREA  TO  PASS  TE9T-PR0BLE*  NUMBER  NPROB 
C  10  THE  FUNCTION  FUNCT  RMICH  RILL  COMPUTE 
C  THE  FUNCTION  VALUES  OF  T E ST-PROBLE M  NPROB 

C  B1  CALLING  THE  TEST-PROBLEM  COLLECTION  SUBROUTINE  GLOMTF 
C 

COMMON  /IUN/  NpROB 
C 

c  *0  INITIAL  POINT 

C  IN  IN  FINAL  tSTIRAIC  OF  6L0BAL  MINIMUM 

C  XH1N6L,  XMAX6L  MUST  RE  DIMENSIONED  MERE  IN  OMER  (TO  CALL 
C  IHE  PRE-EXIST  1*6  SUBROUTINE  6L0MIP. 

D  I  H  [  NS  1  ON  XOClCO),iMlNnOO),XMIN6L(100>,XNAXCL(lOO» 

ir  continue 

c 

c  input  problem  number 

NR!TE(6,20> 

20  FORMATE  It ////*lH  INPUT  PROBLEM  NUMBER  Cl  yO  37,  0  *  STOP)) 
REAO(5,30) NPROB 
3  C  F0RMAT(I2) 

NR  ITE(6,40)NPR0B 

40  F0RPAT(///18H  PROBLEM  NUMBER  *  ,12 //////) 

C 

C  TERMINATE  OR  CONTINUE 

IF (NPROB. Efi. 0)60  TO  50 
C 

C  CALL  6L0NIP  TO  GET  PROBLEM  DIMENSION  N  AND  INITIAL  POINT  *0 
C  NOT F  THAT  GLOMIP  RETURNS  ALSO  THE  BOUNDARIES  XN1NGL  ,  XMAX6L 
C  OF  THE  OBSERVATION  REGION  (NOT  NEE  DF  D  HERE) 

CALL  GL0M1P(NPR0B,N,XQ,XM1NGL,XNAX6L> 

C 

C  SFI  NSUC  SO  AS  TO  HAVE  GOOD  CHANCES,  WITHOUT  PROHUGI TIVC 
C  COMPUTATIONAL  EFFORT 
NSUC  =  5 
C 

C  SFT  IPRINT  SO  AS  TO  HAVE  A  MODERATE  OUTPUT 
IPR1NT  *  0 
C 

C  CALL  DRIVER  SUBROUTINE  SlGMAt 

CA*-*»  S1GMA1CN,  XO.NSUC,  IPRINT,  XMIN,  FMIN,  NEE  v,10uT> 

C  GO  TO  THE  NEXT  PROBLEM 
GO  TO  TO 
C 

C  END  OF  TEST  PROBLEMS 
SO  CONTINUE 

VRIT£(6,60> 

DO  f  ORM AT (  72  2  H  END  OF  TEST  PROBLEMS  /> 


40 


c 


0 1  ME  MS  10k  W(N) 


1001  . 
190?. 
190’  . 
190*. 
1905. 
19C«. 

1907. 

1908. 

1909. 

1910. 
1911  . 
1912. 
191». 
191*. 
1915. 
19i*. 

1917. 

1918. 
1«1«. 
1920  . 

1921. 

1922. 
192?. 


C 


C 


C 

C 

C 


c 

c 


1C 


2C 


NN  =  (NO)/? 

DO  20  I  *  1,h* 

11  =  14M-I 

CONTINUE 
X  *  CHAOS  1-2) 

1  =  CHAOS {— 2 ) 

R  x  X«X«V*Y 

IE (S.fcT.I .00)  60  TO  tO 

R  *  DsqRT(-2.D0-«0l06CR)/R) 

W<I)  *  X*  R 
WU1)  =  T  *8 

CONTINUE 

RETURN 

END 


192*. 

SUBROUTINE  UNITRVE 

1925  . 

C 

1926. 

C 

GENERATES  A  RANDOM  VEC 

1927. 

c 

ON 

THE  UNIT  SPHERE. 

1928. 

c 

1929. 

DOUBLE  PRECISION  W 

1930. 

c 

1931  . 

DIMENSION  WEN) 

1932. 

c 

1933. 

CALL  G AUSRVlN .W ) 

193*. 

WW  *  0 . DO 

1935. 

c 

193< 

00  10  1  =  1,N 

1937. 

WW  «  WW>W*I)«*2 

1938. 

1C 

CONTINUE 

1939. 

WW  x  1  .  D3/DS0RT  (WW 

19*0. 

c 

19*1. 

DO  20  I  «  1.N 

19*2. 

WEI)  *  WW* WEI) 

19*3. 

20 

CONTINUE 

19**. 

c 

19*5. 

RETURN 

19*6. 

ENO 

ENO  UN  0*5  IBANK  5605  DBANK  1*797  COMMON 


9. 


tenendo  la  geometria  di  valenza  costante  (con  le  lunghezze 

di  legame  e  gli  angoli  di  valenza  risultanti  dalla  analisi 

[6  1 

cr istallograf ica  della  citosina-3 ' -fosf ato  ),  Mediante  un  pro 
cedimento  di  best-fit  con  tali  energie  fu  trovata  una  fun- 
zione  di  potenziale  (abbreviata  TCM  dalle  iniziali  degli  au- 
tori  del  rif.[5]),  costituita  da  un '  espressione  di  Lennard-Jo 
nes  per  le  energie  di  interazione  fra  atomi  non  legati  e  da 
un 1 espressione  di  Pitzer  per  le  energie  torsionali  intrinse- 
che : 


E($  )  =  l  (- 


Aij  s 

— t-  +  -HE 


-  K  (1  +  cos  3  *.  ), 
i=l  2  ♦!  l  * 


dove  i  $  ^  sono  gli  angoli  di  torsione  y#.°-  ,  a  ,  c  ,  e  espressi  in  r ad i an¬ 
ti  e  dove  la  sorruna  r  e  estesa  alle  coppie  di  atomi  non  1  er 

x  >  j 

ti  e  dove  si  e  assunto  nullo  il  contributo  elettrostatico. 

I  valori  numerici  dei  parametri  A,  B  e  K  sono  riporta 

$  — 

ti  nella  Tabella  1  del  rxf.[7].  Si  osservi  che  gli  ossigeni 
del  gruppo  PO^  hanno  il  coefficiente  attrattivo  A  sensibi1- 
mente  piu  elevato,  e  il  coefficiente  repulsivo  B  sensibilmen 
te  piu  basso,  degli  altri  ossigeni:  cor r ispondentemente  tan 
to  l'ascissa  quanto  l'ordinata  del  punto  di  minimo  della  cur 
va  energia-distanza  sono  nettamente  inferion  nel  primo  caso 

O  O 

che  nel  secondo  \2,04  A  contro  2,72  A  e  -10,59  KJmol  con- 
tro  -0,61  KJmol  ^).  C'e  quindi  da  aspettarsi  che  il  potenzia 
le  TCM  tenda  a  favonre  strutture  stabilizzate  da  legami  di 
idrogeno  l nt r amolecol ar l .  Ed  infatti  1  '  appl icaz lone  del  nuo- 
vo  metodo  porta  ad  un  minimo  globale  ,  rappresenta- 
to  in  Figura  2  (con  «  =  176,2°,  C  =  180,0°,  a  =  122,1°, 


6  =-96,7°,y  =  55,6°,  E  =  -94,0  KJmol  ),  caratter izzato  da 
contatt 1  H(C3')...06  =  1,75  A,  H(C2')...03  =  1,82  A, 

H  ( C2 '  )  ...05'  =  2,47  A.  Si  osservi  che  un  procedimento  di  r£ 

[  9  I 

cerca  "diretta"  del  minimi  di  piu  bassa  energia  aveva  porta 
to  all ' individuazione  di  due  conf ormaz ioni  di  bassa  energia, 
la  pnma  con  c  =  -75°,  i  =  180°,  =  70°,  B  =  -110°, 

Y  =  55°,  E  =  -91,9  KJmol-1  e  la  seconda  con  e  =  -170°, 
C  =180°,  o  =  115°,  B  =-100°,  Y  =  55°,  E  =  -90,4  KJmol-1  .  II  minimo 
globale  ottenuto  tramite  il  metodo  qui  usato  costituisce  un 
guadagno  energetico  di  3,6  KJmol-1  . 


4.-  CONCLUSION! 


L'uso  di  un  nuovo  algoritmo  di  minimi22azione  delle  fun 
zioni  di  energia  potenziale  intramolecolare ,  la  cui  concezio 
ne  si  distacca  radicalmente  da  quella  dei  metodi  finora  pro- 
posti,  pone  una  serie  di  problemi  ai  quali  solo  l’espressio- 
ne  acquisita  attraverso  1 ’ appl icazione  ad  un  elevato  numero 
di  casi  potra  dare  una  risposta  completa.  Ci  limitiamo  qui 
ad  indicarne  1  principali. 

Data  la  natura  non  deterministica  del  nuovo  algoritmo 
la  probability  di  individuare  il  minimo  globale  tende  ad  1 
al  tendere  all'infinito  del  numero  di  valutazioni  della  fun- 
zione,  e,  di  conseguenza,  nel  tempo  di  calcolo  necessano 
alia  loro  esecuzione.  Per  tenere  conto  di  questa  peculiari-.i 
del  programma,  e  possibile  decidere  a  priori  quante  volt- 
si  vuole  che  un  lancio  finisca  nel  medesimo  minimo  prima  che 
questo  possa  essere  considerato  come  il  minimo  globale.  Quan 
to  piu  elevato  e  questo  numero,  tanto  piu  la  probability  di 
aver  trovato  il  minimo  globale  si  avvicina  alia  certezzo. 
Nel  nostro  esempio  esso  e  stato  posto  uguale  a  5. 

Un  altro  punto  di  notevole  importanza  e  1 ' accur atezza 
ottembile  nella  valutazione  del  punto  di  minima  energia. 
Proprio  perche  il  suo  scopo  essenziale  e  1 ' indi viduaz ione 
del  punto  di  minimo  globale,  il  programma  non  raggiunge  il 
grado  di  accuratezza  raggiunto  da  altri  metodi  di  minimizza- 
zione,  canto  che  e  oppor t uno , quando  si  sia  individuato  il 
minimo,  applicare  un  metodo  piu  rapido  di  minimizzazione  locale, 
ad  os.  un  netodo  a  convergenza  quadr at ica, quale  quello  di  Newton-Raphson, 


i 
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flCUOA  2-11  fraaaento  C2'(endo>  desosst  SPS  nella  con(or«iiiont 
d «  a  in i mj  energia  t  ro va  t  a  con  it  nuovo  algoritao.  1  ce  r  c  h  t 
t ra i t egg i a t i  c or ri spondono  agti  atoni  di  ots igrno  c  it  ctrchio 
pirno  jll'itoao  oi  fojforo.  Per  aaggiore  chiaretn  graficat  i  IB 
atosi  di  idrojeno  sono  stati  omessi. 
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